Nov 01 03:39:10.656928 ip-10-0-136-214 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 01 03:39:10.656942 ip-10-0-136-214 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 01 03:39:10.656952 ip-10-0-136-214 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 01 03:39:10.657294 ip-10-0-136-214 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 01 03:39:20.841182 ip-10-0-136-214 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 01 03:39:20.841197 ip-10-0-136-214 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ccceaaf2ab224012b1783a943ab6a75e --
Nov 01 03:41:45.129500 ip-10-0-136-214 systemd[1]: Starting Kubernetes Kubelet...
Nov 01 03:41:45.522597 ip-10-0-136-214 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 01 03:41:45.522597 ip-10-0-136-214 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 01 03:41:45.522597 ip-10-0-136-214 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 01 03:41:45.522597 ip-10-0-136-214 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 01 03:41:45.526506 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526423    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:41:45.526506 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526505    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:41:45.526506 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526509    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526513    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526516    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526519    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526521    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526524    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526527    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526530    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526532    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526535    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526538    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526554    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526558    2580 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526562    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526565    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526567    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526570    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526574    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526576    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526579    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:41:45.526595 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526582    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526584    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526587    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526589    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526592    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526595    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526598    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526601    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526604    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526607    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526610    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526612    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526616    2580 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526618    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526621    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526623    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526626    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526628    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526631    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526633    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:41:45.527056 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526636    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526638    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526641    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526643    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526646    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526648    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526651    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526653    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526656    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526658    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526662    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526667    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526670    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526673    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526676    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526679    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526682    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526686    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526688    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:41:45.527550 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526691    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526693    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526695    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526698    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526700    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526704    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526707    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526709    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526712    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526714    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526716    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526720    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526722    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526725    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526727    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526730    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526732    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526735    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526737    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526740    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:41:45.528012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526743    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526745    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526748    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526750    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526754    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526757    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526760    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526764    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526766    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526769    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526772    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526775    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526777    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526780    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526782    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526785    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526787    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526790    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526792    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:41:45.528591 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526795    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526797    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526800    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526802    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526805    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.526808    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527642    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527650    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527653    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527656    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527659    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527661    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527664    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527667    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527669    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527672    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527674    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527677    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527680    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:41:45.529088 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527682    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527687    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527689    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527692    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527695    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527698    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527700    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527703    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527705    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527708    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527711    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527713    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527716    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527719    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527722    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527725    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527727    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527730    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527734    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527738    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:41:45.529573 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527742    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527745    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527747    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527750    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527752    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527755    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527757    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527760    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527763    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527767    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527770    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527773    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527776    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527780    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527782    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527785    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527788    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527790    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527793    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:41:45.530045 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527796    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527798    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527801    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527804    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527807    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527809    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527811    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527814    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527817    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527819    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527822    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527824    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527827    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527830    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527833    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527835    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527838    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527840    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527843    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:41:45.530504 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527845    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527848    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527850    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527853    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527855    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527858    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527860    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527864    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527867    2580 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527869    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527872    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527874    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527877    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527879    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527882    2580 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527884    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527887    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527889    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527893    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527895    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:41:45.530952 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527898    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527900    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527902    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527905    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527907    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527910    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527912    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527917    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527920    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527922    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527925    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527928    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527930    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527933    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.527935    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528512    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528519    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528522    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528525    2580 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528529    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:41:45.531439 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528532    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528535    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528538    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528540    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528543    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528546    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528548    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528551    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528553    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528556    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528559    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528561    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528564    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528566    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528569    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528571    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528574    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528577    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528579    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528582    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:41:45.531913 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528585    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528588    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528590    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528593    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528596    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528598    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528601    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528603    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528606    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528609    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528614    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528618    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528621    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528623    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528626    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528628    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528631    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528634    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528636    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:41:45.532423 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528639    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528641    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528644    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528646    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528649    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528651    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528654    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528656    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528659    2580 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528661    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528664    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528666    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528670    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528674    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528677    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528681    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528683    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528686    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528689    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:41:45.532899 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528691    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528694    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528696    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528700    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528703    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528706    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528709    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528712    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528714    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528717    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528719    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528724    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528727    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528729    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528732    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528734    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528737    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528740    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528742    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:41:45.533365 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528745    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528747    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528750    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528752    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528755    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528757    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528760    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528763    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528766    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528769    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528771    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528774    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528777    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528779    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528782    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528784    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528787    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528789    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528792    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528794    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:41:45.533898 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528797    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528799    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528802    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.528805    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529785    2580 flags.go:64] FLAG: --address="0.0.0.0"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529796    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529802    2580 flags.go:64] FLAG: --anonymous-auth="true"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529807    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529812    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529815    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529820    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529824    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529828    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529831    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529834    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529838    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529841    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529844    2580 flags.go:64] FLAG: --cgroup-root=""
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529847    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529850    2580 flags.go:64] FLAG: --client-ca-file=""
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529854    2580 flags.go:64] FLAG: --cloud-provider="external"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529860    2580 flags.go:64] FLAG: --cluster-dns="[]"
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529864    2580 flags.go:64] FLAG: --cluster-domain=""
Nov 01 03:41:45.534405 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529867    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529871    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529874    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529877    2580 flags.go:64] FLAG: --container-log-max-files="5"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529881    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529885    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529888    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529892    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529894    2580 flags.go:64] FLAG: --contention-profiling="false"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529897    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529901    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529904    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529907    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529913    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529916    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529919    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529922    2580 flags.go:64] FLAG: --enable-load-reader="false"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529926    2580 flags.go:64] FLAG: --enable-server="true"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529929    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529932    2580 flags.go:64] FLAG: --event-burst="100"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529936    2580 flags.go:64] FLAG: --event-qps="50"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529939    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529942    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529945    2580 flags.go:64] FLAG: --eviction-hard=""
Nov 01 03:41:45.534926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529949    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529952    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529955    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529958    2580 flags.go:64] FLAG: --eviction-soft=""
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529961    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529964    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529969    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529973    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529976    2580 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529979    2580 flags.go:64] FLAG: --fail-swap-on="true"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529982    2580 flags.go:64] FLAG: --feature-gates=""
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529986    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529989    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529993    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.529996    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530000    2580 flags.go:64] FLAG: --healthz-port="10248"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530003    2580 flags.go:64] FLAG: --help="false"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530006    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530009    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530012    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530015    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530021    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530024    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 01 03:41:45.535520 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530027    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530030    2580 flags.go:64] FLAG: --image-service-endpoint=""
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530033    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530036    2580 flags.go:64] FLAG: --kube-api-burst="100"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530039    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530043    2580 flags.go:64] FLAG: --kube-api-qps="50"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530046    2580 flags.go:64] FLAG: --kube-reserved=""
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530049    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530052    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530055    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530059    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530062    2580 flags.go:64] FLAG: --lock-file=""
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530064    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530067    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530071    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530077    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530080    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530084    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530087    2580 flags.go:64] FLAG: --logging-format="text"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530090    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530093    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530096    2580 flags.go:64] FLAG: --manifest-url=""
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530099    2580 flags.go:64] FLAG: --manifest-url-header=""
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530104    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530107    2580 flags.go:64] FLAG: --max-open-files="1000000"
Nov 01 03:41:45.536086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530111    2580 flags.go:64] FLAG: --max-pods="110"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530114    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530117    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530120    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530123    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530127    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530130    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530133    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530141    2580 flags.go:64] FLAG: --node-status-max-images="50"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530144    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530147    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530150    2580 flags.go:64] FLAG: --pod-cidr=""
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530153    2580 flags.go:64] FLAG: --pod-manifest-path=""
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530156    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530159    2580 flags.go:64] FLAG: --pods-per-core="0"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530172    2580 flags.go:64] FLAG: --port="10250"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530175    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530178    2580 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-096b4d7e9e6c5ca91"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530181    2580 flags.go:64] FLAG: --qos-reserved=""
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530184    2580 flags.go:64] FLAG: --read-only-port="10255"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530188    2580 flags.go:64] FLAG: --register-node="true"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530191    2580 flags.go:64] FLAG: --register-with-taints=""
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530195    2580 flags.go:64] FLAG: --registry-burst="10"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530198    2580 flags.go:64] FLAG: --registry-qps="5"
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530201    2580 flags.go:64] FLAG: --reserved-cpus=""
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530205    2580 flags.go:64] FLAG: --reserved-memory=""
Nov 01 03:41:45.536705 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530209    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530212    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530215    2580 flags.go:64] FLAG: --rotate-certificates="false"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530218    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530221    2580 flags.go:64] FLAG: --runonce="false"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530224    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530227    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530230    2580 flags.go:64] FLAG: --seccomp-default="false"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530233    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530236    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530239    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530243    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530246    2580 flags.go:64] FLAG: --storage-driver-password="root"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530249    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530252    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530254    2580 flags.go:64] FLAG: --storage-driver-user="root"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530258    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530261    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530264    2580 flags.go:64] FLAG: --system-cgroups=""
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530267    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530272    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530275    2580 flags.go:64] FLAG: --tls-cert-file=""
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530278    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530282    2580 flags.go:64] FLAG: --tls-min-version=""
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530285    2580 flags.go:64] FLAG: --tls-private-key-file=""
Nov 01 03:41:45.537374 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530287    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530290    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530293    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530297    2580 flags.go:64] FLAG: --v="2"
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530301    2580 flags.go:64] FLAG: --version="false"
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530306    2580 flags.go:64] FLAG: --vmodule=""
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530310    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530314    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530450    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530453    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530456    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530459    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530461    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530464    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530467    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530469    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530472    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530475    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530477    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530480    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530483    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:41:45.538217 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530485    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530487    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530490    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530493    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530495    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530498    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530501    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530503    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530506    2580 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530508    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530511    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530514    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530516    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530519    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530522    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530524    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530527    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530529    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530532    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530535    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:41:45.538896 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530538    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530541    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530543    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530546    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530548    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530551    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530553    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530556    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530558    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530561    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530564    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530566    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530569    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530571    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530574    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530576    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530579    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530582    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530584    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:41:45.539395 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530587    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530589    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530591    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530594    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530596    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530599    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530602    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530606    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530608    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530611    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530614    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530616    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530618    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530621    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530624    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530626    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530629    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530631    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530634    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:41:45.539850 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530638    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530641    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530645    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530649    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530652    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530655    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530658    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530660    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530663    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530665    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530668    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530671    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530673    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530676    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530679    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530681    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530684    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530686    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530689    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530691    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:41:45.540371 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530695    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530698    2580 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530700    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530703    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530705    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530708    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530711    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530714    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530717    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530719    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530722    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530725    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530727    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530730    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530734    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.530761    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 01 03:41:45.540854 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530796    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530800    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530804    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530806    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530810    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530815    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530818    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530822    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530824    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530827    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530830    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530833    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530836    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530838    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530841    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530844    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530848    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530850    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530853    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:41:45.541258 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530855    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530858    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530860    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530863    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530865    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530868    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530871    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530874    2580 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530876    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530879    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530881    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530884    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530886    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530891    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530894    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530896    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530899    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530901    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530904    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530906    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:41:45.541712 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530909    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530911    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530914    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530916    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530919    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530922    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530924    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530927    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530929    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530933    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530936    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530938    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530941    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530943    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530946    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530949    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530951    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530954    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530957    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:41:45.542198 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530960    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530963    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530965    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530968    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530970    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530974    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530978    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530980    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530982    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530985    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530988    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530990    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530992    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530995    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.530997    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531000    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531002    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531005    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531008    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:41:45.542660 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531012    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531015    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531017    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531021    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531024    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531026    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531029    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531032    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531034    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531037    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531039    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531042    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531044    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531047    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531050    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531052    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531055    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531057    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531060    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531064    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:41:45.543202 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531066    2580 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531069    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531071    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531074    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531076    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531080    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531082    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531085    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.531087    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.539325    2580 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.539343    2580 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.539367    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.539372    2580 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539436    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539441    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539445    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539448    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539451    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539454    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539457    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:41:45.543706 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539460    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539462    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539465    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539468    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539471    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539473    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539476    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539479    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539481    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539484    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539488    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539491    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539494    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539503    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539507    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539509    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539512    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539515    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539517    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:41:45.544292 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539520    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539523    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539526    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539529    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539532    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539535    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539538    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539541    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539543    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539546    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539549    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539551    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539554    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539556    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539559    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539562    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539565    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539567    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539570    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:41:45.544746 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539572    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539575    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539578    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539580    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539583    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539585    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539588    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539591    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539593    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539596    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539598    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539601    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539604    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539606    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539609    2580 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539611    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539616    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539620    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539623    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:41:45.545220 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539626    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539629    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539631    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539635    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539637    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539640    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539643    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539645    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539648    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539651    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539653    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539656    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539659    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539661    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539664    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539672    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539675    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539678    2580 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539680    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539683    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:41:45.545673 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539686    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539688    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539691    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539693    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539696    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539699    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539701    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539704    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539707    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539709    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539712    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539715    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539717    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539720    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539723    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539726    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539728    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539731    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539733    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539736    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:41:45.546204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539738    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539741    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.539771    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539937    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539946    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539949    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539952    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539955    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539972    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539976    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539978    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539981    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539984    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539986    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539989    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539992    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539994    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:41:45.546713 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.539997    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540000    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540003    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540005    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540009    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540012    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540014    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540017    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540019    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540022    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540025    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540027    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540030    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540032    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540035    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540038    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540040    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540043    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540046    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:41:45.547130 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540048    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540051    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540053    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540056    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540058    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540066    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540069    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540072    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540075    2580 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540077    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540080    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540083    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540085    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540088    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540090    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540093    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540096    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540098    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540101    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540104    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:41:45.547680 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540106    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540109    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540111    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540114    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540116    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540119    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540121    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540124    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540126    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540129    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540131    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540133    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540136    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540138    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540141    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540143    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540146    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540149    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540157    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:41:45.548185 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540174    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540178    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540181    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540184    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540186    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540189    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540191    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540194    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540196    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540199    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540202    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540204    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540207    2580 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540209    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540212    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540215    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540217    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540220    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540224    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:41:45.548650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540227    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540231    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540234    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540237    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540241    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540244    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540247    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540250    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540252    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540255    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540257    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540260    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540262    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540271    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540274    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.540299    2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 01 03:41:45.549110 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540332    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540336    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540339    2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540342    2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540345    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540348    2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540350    2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540353    2580 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540356    2580 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540358    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540361    2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540364    2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540366    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540369    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540372    2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540375    2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540377    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540380    2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540383    2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540385    2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:41:45.549513 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540388    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540390    2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540393    2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540396    2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540398    2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540401    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540403    2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540406    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540409    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540411    2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540420    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540423    2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540425    2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540428    2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540430    2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540433    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540435    2580 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540438    2580 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540441    2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:41:45.550090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540443    2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540446    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540449    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540451    2580 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540454    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540456    2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540459    2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540461    2580 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540464    2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540466    2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540469    2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540471    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540474    2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540477    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540479    2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540482    2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540484    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540487    2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540489    2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540492    2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:41:45.550589 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540494    2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540497    2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540499    2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540502    2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540511    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540513    2580 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540516    2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540518    2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540521    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540524    2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540526    2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540529    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540532    2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540535    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540537    2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540540    2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540545    2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540548    2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540550    2580 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:41:45.551112 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540553    2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540556    2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540558    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540561    2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540563    2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540566    2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540568    2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540571    2580 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540574    2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540576    2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540579    2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540581    2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540584    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540588    2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540591    2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540594    2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540599    2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540603    2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540614    2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:41:45.551751 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540618    2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540620    2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540623    2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540625    2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540628    2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540630    2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540633    2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540636    2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:45.540638    2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.540704    2580 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.542820    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.543932    2580 server.go:1014] "Starting client certificate rotation"
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.544028    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.544761    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.546097    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 01 03:41:45.552411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.547456    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 01 03:41:45.556544 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.556526    2580 log.go:25] "Validated CRI v1 runtime API"
Nov 01 03:41:45.559743 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.559728    2580 log.go:25] "Validated CRI v1 image API"
Nov 01 03:41:45.561151 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.561126    2580 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 01 03:41:45.563758 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.563736    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c1a1e22b-1a90-421c-a953-ecc8303a6ac3:/dev/nvme0n1p3 ef8d7415-c6c9-4eae-9a73-f11b2b1a36f1:/dev/nvme0n1p4]
Nov 01 03:41:45.563830 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.563756    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 01 03:41:45.569595 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.569477    2580 manager.go:217] Machine: {Timestamp:2026-11-01 03:41:45.568211277 +0000 UTC m=+0.325802644 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100059 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec294a8634e83bc48b1bd46672c2b297 SystemUUID:ec294a86-34e8-3bc4-8b1b-d46672c2b297 BootID:ccceaaf2-ab22-4012-b178-3a943ab6a75e Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:c5:e0:56:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:c5:e0:56:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:d3:e8:3b:ed:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 01 03:41:45.570129 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.570119    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 01 03:41:45.570270 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.570253    2580 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 01 03:41:45.572991 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.572962    2580 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 01 03:41:45.573149 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.572992    2580 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-214.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 01 03:41:45.573216 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.573155    2580 topology_manager.go:143] "Creating topology manager with none policy"
Nov 01 03:41:45.573216 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.573175    2580 container_manager_linux.go:311] "Creating device plugin manager"
Nov 01 03:41:45.573216 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.573214    2580 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 01 03:41:45.573295 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.573243    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 01 03:41:45.574009 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.573999    2580 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 01 03:41:45.577777 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.577765    2580 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 01 03:41:45.577910 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.577900    2580 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 01 03:41:45.578608 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.578598    2580 kubelet.go:493] "Attempting to sync node with API server"
Nov 01 03:41:45.578642 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.578616    2580 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 01 03:41:45.578642 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.578626    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 01 03:41:45.578722 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.578676    2580 kubelet.go:405] "Adding apiserver pod source"
Nov 01 03:41:45.578722 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.578709    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 01 03:41:45.579219 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.579203    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 01 03:41:45.583388 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.583367    2580 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 01 03:41:45.588246 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.588234    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 01 03:41:45.588977 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.588966    2580 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 01 03:41:45.589021 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.588996    2580 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 01 03:41:45.589152 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589141    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 01 03:41:45.589210 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589176    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 01 03:41:45.589210 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589185    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 01 03:41:45.589210 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589192    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 01 03:41:45.589210 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589199    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 01 03:41:45.589210 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589209    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 01 03:41:45.589674 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589665    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 01 03:41:45.589703 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589675    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 01 03:41:45.589703 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589682    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 01 03:41:45.589703 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589688    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 01 03:41:45.589703 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589697    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 01 03:41:45.589860 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.589705    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 01 03:41:45.590455 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.590446    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 01 03:41:45.590455 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.590455    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 01 03:41:45.594153 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.594140    2580 server.go:1263] "Started kubelet"
Nov 01 03:41:45.594273 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.594218    2580 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 01 03:41:45.594770 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.594255    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 01 03:41:45.594858 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.594794    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 01 03:41:45.595034 ip-10-0-136-214 systemd[1]: Started Kubernetes Kubelet.
Nov 01 03:41:45.595774 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.595759    2580 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 01 03:41:45.596296 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.596284    2580 server.go:317] "Adding debug handlers to kubelet server"
Nov 01 03:41:45.599492 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.599476    2580 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 01 03:41:45.602529 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.602510    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 01 03:41:45.602996 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.602981    2580 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 01 03:41:45.603078 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.603064    2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-214.us-west-2.compute.internal\" not found"
Nov 01 03:41:45.603545 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.603495    2580 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 01 03:41:45.603545 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.603526    2580 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 01 03:41:45.603676 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.603636    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 01 03:41:45.603723 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.603696    2580 reconstruct.go:97] "Volume reconstruction finished"
Nov 01 03:41:45.603723 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.603703    2580 reconciler.go:29] "Reconciler: start to sync state"
Nov 01 03:41:45.603855 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.603843    2580 factory.go:55] Registering systemd factory
Nov 01 03:41:45.603890 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.603861    2580 factory.go:223] Registration of the systemd container factory successfully
Nov 01 03:41:45.604087 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.604070    2580 factory.go:153] Registering CRI-O factory
Nov 01 03:41:45.604087 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.604086    2580 factory.go:223] Registration of the crio container factory successfully
Nov 01 03:41:45.604251 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.604124    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 01 03:41:45.604251 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.604142    2580 factory.go:103] Registering Raw factory
Nov 01 03:41:45.604251 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.604153    2580 manager.go:1199] Started watching for new ooms in manager
Nov 01 03:41:45.605154 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.605140    2580 manager.go:319] Starting recovery of all containers
Nov 01 03:41:45.617945 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.617915    2580 manager.go:324] Recovery completed
Nov 01 03:41:45.622810 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.622794    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:41:45.624939 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.624917    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:41:45.625011 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.624956    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:41:45.625011 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.624969    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:41:45.625599 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.625581    2580 cpu_manager.go:226] "Starting" policy="none"
Nov 01 03:41:45.625599 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.625596    2580 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 01 03:41:45.625696 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.625614    2580 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 01 03:41:45.625696 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.625585    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:41:45.626391 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.626372    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:41:45.626481 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.626402    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:41:45.626481 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.626414    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:41:45.627710 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.627696    2580 policy_none.go:50] "Start"
Nov 01 03:41:45.627779 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.627714    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 01 03:41:45.627779 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.627724    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 01 03:41:45.629710 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.629699    2580 policy_none.go:44] "Start"
Nov 01 03:41:45.667885 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.667841    2580 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 01 03:41:45.672175 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.672143    2580 manager.go:341] "Starting Device Plugin manager"
Nov 01 03:41:45.672280 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.672197    2580 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 01 03:41:45.672280 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.672211    2580 server.go:87] "Starting device plugin registration server"
Nov 01 03:41:45.672480 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.672468    2580 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 01 03:41:45.672536 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.672480    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 01 03:41:45.672598 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.672581    2580 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 01 03:41:45.672688 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.672666    2580 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 01 03:41:45.672688 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.672680    2580 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 01 03:41:45.673324 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.673305    2580 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 01 03:41:45.673398 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.673361    2580 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-214.us-west-2.compute.internal\" not found"
Nov 01 03:41:45.738451 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.738402    2580 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-214.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 01 03:41:45.739306 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.738401    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-214.us-west-2.compute.internal.18e3ced86effec1f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-214.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-214.us-west-2.compute.internal,},FirstTimestamp:2026-11-01 03:41:45.594113055 +0000 UTC m=+0.351704422,LastTimestamp:2026-11-01 03:41:45.594113055 +0000 UTC m=+0.351704422,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-214.us-west-2.compute.internal,}"
Nov 01 03:41:45.772833 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.772734    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:41:45.774182 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.774145    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:41:45.774287 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.774196    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:41:45.774287 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.774209    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:41:45.774287 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.774236    2580 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:45.784909 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.784888    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-214.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 01 03:41:45.825352 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.806220    2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 01 03:41:45.825352 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.806265    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lfwcj"
Nov 01 03:41:45.851271 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.851234    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 01 03:41:45.852472 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.852454    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 01 03:41:45.852544 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.852481    2580 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 01 03:41:45.852544 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.852504    2580 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 01 03:41:45.852640 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.852546    2580 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 01 03:41:45.895054 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.895030    2580 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:41:45.942219 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.942091    2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:41:45.952713 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.952668    2580 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"]
Nov 01 03:41:45.952854 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.952748    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:41:45.953820 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.953800    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:41:45.953940 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.953831    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:41:45.953940 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.953844    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:41:45.956173 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.956150    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:41:45.956305 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.956288    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:45.956358 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.956321    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:41:45.956958 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.956940    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:41:45.957045 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.956969    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:41:45.957045 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.956979    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:41:45.957045 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.956945    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:41:45.957045 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.957039    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:41:45.957186 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.957049    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:41:45.958984 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.958969    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:45.959050 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.958998    2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:41:45.959779 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.959761    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:41:45.959839 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.959798    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:41:45.959839 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.959815    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:41:45.985745 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.985724    2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-214.us-west-2.compute.internal\" not found" node="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:45.987804 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.987786    2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-214.us-west-2.compute.internal\" not found" node="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:45.989827 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.989804    2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:41:45.991020 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.991005    2580 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:41:45.991464 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:45.991451    2580 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:45.991530 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:45.991471    2580 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-214.us-west-2.compute.internal\": node \"ip-10-0-136-214.us-west-2.compute.internal\" not found"
Nov 01 03:41:46.004724 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.004699    2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.005397 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.005376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.005487 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.005401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67398c77b717adfae75e6234ca803488-config\") pod \"kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"67398c77b717adfae75e6234ca803488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.005487 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.005419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.065055 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.064973    2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 01 03:41:46.065248 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.065108    2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.106024 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.105999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.106155 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.106027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67398c77b717adfae75e6234ca803488-config\") pod \"kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"67398c77b717adfae75e6234ca803488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.106155 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.106044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.106155 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.106111    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67398c77b717adfae75e6234ca803488-config\") pod \"kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"67398c77b717adfae75e6234ca803488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.106155 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.106111    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.106329 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.106195    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.121361 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.121338    2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 01 03:41:46.288993 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.288956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.290194 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.290121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:41:46.544919 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.544714    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 01 03:41:46.545551 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.545081    2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 01 03:41:46.545551 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.545113    2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 01 03:41:46.545551 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.545139    2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 01 03:41:46.545551 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:46.545184    2580 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://afdb05243526b4c0e91ef2f637640017-e887bece4d7f5b9e.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-136-214.us-west-2.compute.internal.18e3ced870d6cd7c\": read tcp 10.0.136.214:55846->3.16.134.174:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-136-214.us-west-2.compute.internal.18e3ced870d6cd7c  default   5182 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-214.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-214.us-west-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-214.us-west-2.compute.internal,},FirstTimestamp:2026-11-01 03:41:45 +0000 UTC,LastTimestamp:2026-11-01 03:41:45.774213993 +0000 UTC m=+0.531805361,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-214.us-west-2.compute.internal,}"
Nov 01 03:41:46.580583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.580550    2580 apiserver.go:52] "Watching apiserver"
Nov 01 03:41:46.603558 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.603526    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 01 03:41:46.811526 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.811423    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-31 03:36:46 +0000 UTC" deadline="2028-06-03 22:44:27.706732428 +0000 UTC"
Nov 01 03:41:46.811526 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.811462    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13939h2m40.895273329s"
Nov 01 03:41:46.905450 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.905403    2580 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 01 03:41:46.905744 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.905724    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-zthp4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal","openshift-multus/multus-additional-cni-plugins-8dvks","openshift-multus/multus-nb2ld","openshift-network-diagnostics/network-check-target-wztb4","kube-system/konnectivity-agent-gmh92","openshift-multus/network-metrics-daemon-gcqhv","openshift-network-operator/iptables-alerter-bjkt7","openshift-ovn-kubernetes/ovnkube-node-cx9p7","kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal","openshift-image-registry/node-ca-f2vfp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k","openshift-cluster-node-tuning-operator/tuned-9xmvl","kube-system/global-pull-secret-syncer-m67pw"]
Nov 01 03:41:46.908913 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.908888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:46.911094 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.911074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:46.913422 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.913402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:46.915658 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.915637    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:46.915751 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:46.915726    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:41:46.917881 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.917865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:46.920207 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.920185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:46.920333 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:46.920275    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:41:46.922448 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.922432    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:46.924803 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.924784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:46.927187 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.927159    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:46.929576 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.929558    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:46.931915 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.931895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:46.934210 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.934191    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:46.934318 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:46.934276    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:41:46.975820 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975796    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 01 03:41:46.975950 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975809    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 01 03:41:46.975950 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975851    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 01 03:41:46.975950 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975867    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 01 03:41:46.975950 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975878    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zn4h5\""
Nov 01 03:41:46.975950 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975921    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 01 03:41:46.976121 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975959    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 01 03:41:46.976121 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975970    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jjmfj\""
Nov 01 03:41:46.976121 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.975983    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 01 03:41:46.976121 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.976034    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 01 03:41:46.976121 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.976098    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-prgzf\""
Nov 01 03:41:46.977874 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.977859    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 01 03:41:46.977964 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.977929    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 01 03:41:46.978007 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.977988    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-v2zmn\""
Nov 01 03:41:46.982315 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.982288    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 01 03:41:46.982468 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:46.982451    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7tm86\""
Nov 01 03:41:47.005318 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.005215    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 01 03:41:47.009385 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-kubelet\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.009485 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.009485 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-log-socket\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.009485 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-netd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.009485 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-script-lib\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.009678 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4z49\" (UniqueName: \"kubernetes.io/projected/03fbd825-e35c-44be-9057-71b672a3ce15-kube-api-access-b4z49\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:47.009678 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wz64\" (UniqueName: \"kubernetes.io/projected/939fc194-d0cf-4ee7-8db2-bcf14992affc-kube-api-access-5wz64\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.009678 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.009678 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009647    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-kubelet-config\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.009831 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-system-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.009831 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-cnibin\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.009831 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-netns\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.009831 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.009831 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d5aad3-0b99-49f0-802d-9312cfe33f8d-host\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.010013 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-modprobe-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.010013 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysconfig\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.010013 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-run\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.010013 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jmj\" (UniqueName: \"kubernetes.io/projected/870f99e7-36f6-4e6e-b166-963313638a23-kube-api-access-q9jmj\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.010013 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-slash\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.010013 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.009987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-ovn\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-socket-dir-parent\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-node-log\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-conf\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-cnibin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-iptables-alerter-script\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.010323 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-hostroot\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.010660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-config\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.010660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-host\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.010660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-tmp\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.010660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.010660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-hosts-file\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.010660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcq8d\" (UniqueName: \"kubernetes.io/projected/459de48d-02fa-4213-9351-85502d870f39-kube-api-access-tcq8d\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.010660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89d5aad3-0b99-49f0-802d-9312cfe33f8d-serviceca\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-etc-tuned\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-etc-kubernetes\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsdtl\" (UniqueName: \"kubernetes.io/projected/40a71ede-b75a-4381-8299-49e46083e654-kube-api-access-tsdtl\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-registration-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-device-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-etc-selinux\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-kubernetes\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.010984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-bin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011004 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-conf-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-multus-certs\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ecef226e-8496-4a01-9903-2ecd046af47e-konnectivity-ca\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-host-slash\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-systemd-units\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-lib-modules\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-cni-binary-copy\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-netns\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-sys-fs\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ecef226e-8496-4a01-9903-2ecd046af47e-agent-certs\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-systemd\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.011491 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-var-lib-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011666    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-var-lib-kubelet\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-multus-daemon-config\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-systemd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-env-overrides\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-sys\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-dbus\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-tmp-dir\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-multus\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-socket-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md2fm\" (UniqueName: \"kubernetes.io/projected/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-kube-api-access-md2fm\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-bin\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovn-node-metrics-cert\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.011975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.011976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzf76\" (UniqueName: \"kubernetes.io/projected/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-kube-api-access-qzf76\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.012465 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.012006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4v6\" (UniqueName: \"kubernetes.io/projected/89d5aad3-0b99-49f0-802d-9312cfe33f8d-kube-api-access-7x4v6\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.012465 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.012040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-system-cni-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.012465 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.012063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-kubelet\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.012465 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.012089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-etc-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.012465 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.012107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv9vv\" (UniqueName: \"kubernetes.io/projected/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-kube-api-access-dv9vv\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.012465 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.012220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-k8s-cni-cncf-io\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.074815 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.074715    2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 01 03:41:47.074815 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.074785    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cg59s"
Nov 01 03:41:47.079829 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.079793    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 01 03:41:47.079975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.079815    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 01 03:41:47.079975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.079854    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 01 03:41:47.079975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.079885    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 01 03:41:47.079975 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.079969    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 01 03:41:47.080179 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080079    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 01 03:41:47.080179 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080124    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 01 03:41:47.080179 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080161    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 01 03:41:47.080375 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080213    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 01 03:41:47.080375 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080224    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 01 03:41:47.080375 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080230    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 01 03:41:47.080375 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080305    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 01 03:41:47.080375 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080333    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 01 03:41:47.080592 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080384    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tmt47\""
Nov 01 03:41:47.080592 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080412    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dc6ls\""
Nov 01 03:41:47.080592 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080413    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 01 03:41:47.080592 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080415    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 01 03:41:47.080592 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080455    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qv2jj\""
Nov 01 03:41:47.080592 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080493    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h4w6m\""
Nov 01 03:41:47.080765 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.080599    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 01 03:41:47.112617 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.112716 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-hosts-file\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.112716 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcq8d\" (UniqueName: \"kubernetes.io/projected/459de48d-02fa-4213-9351-85502d870f39-kube-api-access-tcq8d\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.112716 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.112852 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89d5aad3-0b99-49f0-802d-9312cfe33f8d-serviceca\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.112852 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112739    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-hosts-file\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.112852 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-etc-tuned\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.113001 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112739    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.113001 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.112741    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:47.113001 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112922    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-etc-kubernetes\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.113001 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-etc-kubernetes\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.113001 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.112958    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret podName:c8c13245-bedc-4277-8989-8c585941e3c0 nodeName:}" failed. No retries permitted until 2026-11-01 03:41:47.612941684 +0000 UTC m=+2.370533070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret") pod "global-pull-secret-syncer-m67pw" (UID: "c8c13245-bedc-4277-8989-8c585941e3c0") : object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:47.113001 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.112981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsdtl\" (UniqueName: \"kubernetes.io/projected/40a71ede-b75a-4381-8299-49e46083e654-kube-api-access-tsdtl\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-registration-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-device-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-etc-selinux\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-kubernetes\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-bin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113115    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-registration-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113136    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-device-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-conf-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-multus-certs\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113201    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-bin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ecef226e-8496-4a01-9903-2ecd046af47e-konnectivity-ca\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113243    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-kubernetes\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-host-slash\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113245    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-conf-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113281    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-etc-selinux\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113290    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-host-slash\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.113342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113290    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-multus-certs\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-systemd-units\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-lib-modules\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-cni-binary-copy\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113470    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-systemd-units\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-netns\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-sys-fs\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113512    2580 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ecef226e-8496-4a01-9903-2ecd046af47e-agent-certs\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113565    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-lib-modules\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-systemd\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113636    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-sys-fs\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113641    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-systemd\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113653    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89d5aad3-0b99-49f0-802d-9312cfe33f8d-serviceca\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.114103 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-var-lib-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-var-lib-kubelet\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113785    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113793    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ecef226e-8496-4a01-9903-2ecd046af47e-konnectivity-ca\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-multus-daemon-config\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113843    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-netns\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-systemd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-env-overrides\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113907    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-sys\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113955    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-cni-binary-copy\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-dbus\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114012    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-var-lib-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-tmp-dir\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-multus\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-socket-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md2fm\" (UniqueName: \"kubernetes.io/projected/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-kube-api-access-md2fm\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.115028 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-bin\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovn-node-metrics-cert\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzf76\" (UniqueName: \"kubernetes.io/projected/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-kube-api-access-qzf76\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4v6\" (UniqueName: \"kubernetes.io/projected/89d5aad3-0b99-49f0-802d-9312cfe33f8d-kube-api-access-7x4v6\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-system-cni-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-kubelet\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-etc-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv9vv\" (UniqueName: \"kubernetes.io/projected/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-kube-api-access-dv9vv\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-k8s-cni-cncf-io\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114364    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-multus-daemon-config\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114382    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-kubelet\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114415    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-tmp-dir\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114455    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-var-lib-kubelet\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-log-socket\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.113957    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-systemd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114535    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.115896 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114548    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-system-cni-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-netd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114574    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-socket-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114589    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-netd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-script-lib\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114613    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-k8s-cni-cncf-io\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114638    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-sys\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114646    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-kubelet\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4z49\" (UniqueName: \"kubernetes.io/projected/03fbd825-e35c-44be-9057-71b672a3ce15-kube-api-access-b4z49\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114679    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-multus\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wz64\" (UniqueName: \"kubernetes.io/projected/939fc194-d0cf-4ee7-8db2-bcf14992affc-kube-api-access-5wz64\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114724    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-etc-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-kubelet-config\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-system-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114870    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-log-socket\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-cnibin\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.117367 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-netns\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114929    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-env-overrides\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114935    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-bin\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114986    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-system-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.114994    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-kubelet\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115037    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-dbus\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115170    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-netns\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115190    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115254    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d5aad3-0b99-49f0-802d-9312cfe33f8d-host\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115278    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-kubelet-config\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115289    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-modprobe-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115332    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d5aad3-0b99-49f0-802d-9312cfe33f8d-host\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysconfig\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115368    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-cnibin\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-run\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115422    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.117957 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jmj\" (UniqueName: \"kubernetes.io/projected/870f99e7-36f6-4e6e-b166-963313638a23-kube-api-access-q9jmj\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-slash\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115634    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-script-lib\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115624    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysconfig\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115634    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-modprobe-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-ovn\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115692    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-ovn\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115717    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115744    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115774    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-run\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-socket-dir-parent\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115836    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-socket-dir-parent\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-node-log\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-conf\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-cnibin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115927    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-cnibin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:47.118553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115969    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-node-log\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.115974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116030    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-conf\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.116078    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116090    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-iptables-alerter-script\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116124    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-slash\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.116163    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs podName:03fbd825-e35c-44be-9057-71b672a3ce15 nodeName:}" failed. No retries permitted until 2026-11-01 03:41:47.616150132 +0000 UTC m=+2.373741517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs") pod "network-metrics-daemon-gcqhv" (UID: "03fbd825-e35c-44be-9057-71b672a3ce15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-hostroot\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-config\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-host\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-tmp\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116324    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-hostroot\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116428    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-host\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116709    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-iptables-alerter-script\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.116718    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-config\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.117872    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-etc-tuned\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.119289 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.117958    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovn-node-metrics-cert\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.119963 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.117961    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ecef226e-8496-4a01-9903-2ecd046af47e-agent-certs\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:47.119963 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.118990    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-tmp\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.183186 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.183140    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcq8d\" (UniqueName: \"kubernetes.io/projected/459de48d-02fa-4213-9351-85502d870f39-kube-api-access-tcq8d\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.183331 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.183184    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsdtl\" (UniqueName: \"kubernetes.io/projected/40a71ede-b75a-4381-8299-49e46083e654-kube-api-access-tsdtl\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.183559 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.183525    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4z49\" (UniqueName: \"kubernetes.io/projected/03fbd825-e35c-44be-9057-71b672a3ce15-kube-api-access-b4z49\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:47.183615 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.183599    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzf76\" (UniqueName: \"kubernetes.io/projected/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-kube-api-access-qzf76\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.184107 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.184084    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4v6\" (UniqueName: \"kubernetes.io/projected/89d5aad3-0b99-49f0-802d-9312cfe33f8d-kube-api-access-7x4v6\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.186498 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.186463    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jmj\" (UniqueName: \"kubernetes.io/projected/870f99e7-36f6-4e6e-b166-963313638a23-kube-api-access-q9jmj\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.186756 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.186735    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv9vv\" (UniqueName: \"kubernetes.io/projected/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-kube-api-access-dv9vv\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.187096 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.187062    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 01 03:41:47.187096 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.187087    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 01 03:41:47.187275 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.187108    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltsnx for pod openshift-network-diagnostics/network-check-target-wztb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:47.187275 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.187179    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx podName:30e6a857-4975-4101-9e1f-a860bd3fd3af nodeName:}" failed. No retries permitted until 2026-11-01 03:41:47.68715918 +0000 UTC m=+2.444750566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ltsnx" (UniqueName: "kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx") pod "network-check-target-wztb4" (UID: "30e6a857-4975-4101-9e1f-a860bd3fd3af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:47.188315 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.188294    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md2fm\" (UniqueName: \"kubernetes.io/projected/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-kube-api-access-md2fm\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.189085 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.189067    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wz64\" (UniqueName: \"kubernetes.io/projected/939fc194-d0cf-4ee7-8db2-bcf14992affc-kube-api-access-5wz64\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.244178 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.244149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:41:47.264029 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.264004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:41:47.266336 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.266322    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nb2ld"
Nov 01 03:41:47.272342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.272326    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:47.276121 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.276104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:41:47.309283 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.309252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:41:47.311541 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.311524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:41:47.327818 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.327770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:41:47.330231 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.330216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:41:47.549180 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.549137    2580 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:41:47.620877 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.620798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:47.620877 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.620843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:47.621219 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.620939    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:47.621219 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.620950    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:47.621219 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.620996    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret podName:c8c13245-bedc-4277-8989-8c585941e3c0 nodeName:}" failed. No retries permitted until 2026-11-01 03:41:48.620982815 +0000 UTC m=+3.378574171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret") pod "global-pull-secret-syncer-m67pw" (UID: "c8c13245-bedc-4277-8989-8c585941e3c0") : object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:47.621219 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.621021    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs podName:03fbd825-e35c-44be-9057-71b672a3ce15 nodeName:}" failed. No retries permitted until 2026-11-01 03:41:48.621003055 +0000 UTC m=+3.378594411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs") pod "network-metrics-daemon-gcqhv" (UID: "03fbd825-e35c-44be-9057-71b672a3ce15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:47.721890 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.721849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:47.722152 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.722027    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 01 03:41:47.722152 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.722049    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 01 03:41:47.722152 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.722059    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltsnx for pod openshift-network-diagnostics/network-check-target-wztb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:47.722152 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:47.722111    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx podName:30e6a857-4975-4101-9e1f-a860bd3fd3af nodeName:}" failed. No retries permitted until 2026-11-01 03:41:48.722097891 +0000 UTC m=+3.479689261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltsnx" (UniqueName: "kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx") pod "network-check-target-wztb4" (UID: "30e6a857-4975-4101-9e1f-a860bd3fd3af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:47.741658 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:47.741620    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67398c77b717adfae75e6234ca803488.slice/crio-effbc4003012eca7e1fb5d9168910f1f9ea43d1252511efbba6c76843e77e25c WatchSource:0}: Error finding container effbc4003012eca7e1fb5d9168910f1f9ea43d1252511efbba6c76843e77e25c: Status 404 returned error can't find the container with id effbc4003012eca7e1fb5d9168910f1f9ea43d1252511efbba6c76843e77e25c
Nov 01 03:41:47.747452 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.747433    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 03:41:47.796012 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:47.795980    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc462f6853597aa7799ac7948357b2573.slice/crio-8759f3f175e1411f59cd84a0da382512473c30cb06797d190d905b7a9d96464c WatchSource:0}: Error finding container 8759f3f175e1411f59cd84a0da382512473c30cb06797d190d905b7a9d96464c: Status 404 returned error can't find the container with id 8759f3f175e1411f59cd84a0da382512473c30cb06797d190d905b7a9d96464c
Nov 01 03:41:47.856990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.856934    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"c462f6853597aa7799ac7948357b2573","Type":"ContainerStarted","Data":"8759f3f175e1411f59cd84a0da382512473c30cb06797d190d905b7a9d96464c"}
Nov 01 03:41:47.858113 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.858088    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"67398c77b717adfae75e6234ca803488","Type":"ContainerStarted","Data":"effbc4003012eca7e1fb5d9168910f1f9ea43d1252511efbba6c76843e77e25c"}
Nov 01 03:41:47.897457 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.897423    2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:41:47.948870 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:47.948837    2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:41:48.079838 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.079778    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-31 03:36:47 +0000 UTC" deadline="2028-06-20 02:45:57.290785238 +0000 UTC"
Nov 01 03:41:48.079838 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.079826    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14327h4m9.210962626s"
Nov 01 03:41:48.200516 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.200483    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod459de48d_02fa_4213_9351_85502d870f39.slice/crio-13187460c8f733ab1ccdf12b209de8248188b69ca5dbfe5a045bd3eaac2bc87c WatchSource:0}: Error finding container 13187460c8f733ab1ccdf12b209de8248188b69ca5dbfe5a045bd3eaac2bc87c: Status 404 returned error can't find the container with id 13187460c8f733ab1ccdf12b209de8248188b69ca5dbfe5a045bd3eaac2bc87c
Nov 01 03:41:48.201361 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.201340    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac79e70_8d1c_4673_aab0_8d8ad7d76880.slice/crio-b3a0ebba101cfd54e9bbbcc342150b52bc245084174577fa3dd30cb1196dc9eb WatchSource:0}: Error finding container b3a0ebba101cfd54e9bbbcc342150b52bc245084174577fa3dd30cb1196dc9eb: Status 404 returned error can't find the container with id b3a0ebba101cfd54e9bbbcc342150b52bc245084174577fa3dd30cb1196dc9eb
Nov 01 03:41:48.253230 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.253194    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d5aad3_0b99_49f0_802d_9312cfe33f8d.slice/crio-72a2df738f15356962d08fa34212eaf3c363be5155284a0c90a39236c6458ca3 WatchSource:0}: Error finding container 72a2df738f15356962d08fa34212eaf3c363be5155284a0c90a39236c6458ca3: Status 404 returned error can't find the container with id 72a2df738f15356962d08fa34212eaf3c363be5155284a0c90a39236c6458ca3
Nov 01 03:41:48.277100 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.277074    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870f99e7_36f6_4e6e_b166_963313638a23.slice/crio-cbf92ef562d4f76747b684272d690a3926730aaba55208340a82419b95dda0a0 WatchSource:0}: Error finding container cbf92ef562d4f76747b684272d690a3926730aaba55208340a82419b95dda0a0: Status 404 returned error can't find the container with id cbf92ef562d4f76747b684272d690a3926730aaba55208340a82419b95dda0a0
Nov 01 03:41:48.287763 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.287739    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecef226e_8496_4a01_9903_2ecd046af47e.slice/crio-a4f4a60812e4e244788d4618b856c8c749008b4446b361cc8601fde946cfa3e1 WatchSource:0}: Error finding container a4f4a60812e4e244788d4618b856c8c749008b4446b361cc8601fde946cfa3e1: Status 404 returned error can't find the container with id a4f4a60812e4e244788d4618b856c8c749008b4446b361cc8601fde946cfa3e1
Nov 01 03:41:48.337965 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.337914    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939fc194_d0cf_4ee7_8db2_bcf14992affc.slice/crio-9d5afb45a99d26bb448a850d023b29dedd5ec2a0c019396fc455024da185e683 WatchSource:0}: Error finding container 9d5afb45a99d26bb448a850d023b29dedd5ec2a0c019396fc455024da185e683: Status 404 returned error can't find the container with id 9d5afb45a99d26bb448a850d023b29dedd5ec2a0c019396fc455024da185e683
Nov 01 03:41:48.341276 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.341251    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e7df41_2eb8_4dce_8a4f_0170ea4d12e4.slice/crio-ed20760fcc7c0a6da3c68bc93c5bb77352501f8ffe2695a9fdf332ab2f40e1ea WatchSource:0}: Error finding container ed20760fcc7c0a6da3c68bc93c5bb77352501f8ffe2695a9fdf332ab2f40e1ea: Status 404 returned error can't find the container with id ed20760fcc7c0a6da3c68bc93c5bb77352501f8ffe2695a9fdf332ab2f40e1ea
Nov 01 03:41:48.352128 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.352101    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a71ede_b75a_4381_8299_49e46083e654.slice/crio-1f5d02f86a5da390e55ca1375289ab46c8800a6cecc944eb3ff4477e8deb504a WatchSource:0}: Error finding container 1f5d02f86a5da390e55ca1375289ab46c8800a6cecc944eb3ff4477e8deb504a: Status 404 returned error can't find the container with id 1f5d02f86a5da390e55ca1375289ab46c8800a6cecc944eb3ff4477e8deb504a
Nov 01 03:41:48.362490 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:41:48.362459    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9f5780_5d84_44be_bf3a_b3eb26d0808c.slice/crio-527cc793cecb8fc1eb028e2e485cfd1883a8ae4f42093c371a7d9eaafe0f3a4f WatchSource:0}: Error finding container 527cc793cecb8fc1eb028e2e485cfd1883a8ae4f42093c371a7d9eaafe0f3a4f: Status 404 returned error can't find the container with id 527cc793cecb8fc1eb028e2e485cfd1883a8ae4f42093c371a7d9eaafe0f3a4f
Nov 01 03:41:48.629272 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.629234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:48.629272 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.629276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:48.629968 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.629390    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:48.629968 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.629391    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:48.629968 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.629446    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret podName:c8c13245-bedc-4277-8989-8c585941e3c0 nodeName:}" failed. No retries permitted until 2026-11-01 03:41:50.629432706 +0000 UTC m=+5.387024077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret") pod "global-pull-secret-syncer-m67pw" (UID: "c8c13245-bedc-4277-8989-8c585941e3c0") : object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:48.629968 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.629461    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs podName:03fbd825-e35c-44be-9057-71b672a3ce15 nodeName:}" failed. No retries permitted until 2026-11-01 03:41:50.629454787 +0000 UTC m=+5.387046142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs") pod "network-metrics-daemon-gcqhv" (UID: "03fbd825-e35c-44be-9057-71b672a3ce15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:48.730606 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.730574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:48.730862 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.730715    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 01 03:41:48.730862 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.730733    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 01 03:41:48.730862 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.730742    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltsnx for pod openshift-network-diagnostics/network-check-target-wztb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:48.730862 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.730803    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx podName:30e6a857-4975-4101-9e1f-a860bd3fd3af nodeName:}" failed. No retries permitted until 2026-11-01 03:41:50.730778949 +0000 UTC m=+5.488370306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltsnx" (UniqueName: "kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx") pod "network-check-target-wztb4" (UID: "30e6a857-4975-4101-9e1f-a860bd3fd3af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:48.853471 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.853441    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:48.853471 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.853464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:48.853714 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.853474    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:48.853714 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.853542    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:41:48.853714 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.853638    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:41:48.853714 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:48.853691    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:41:48.860640 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.860606    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nb2ld" event={"ID":"40a71ede-b75a-4381-8299-49e46083e654","Type":"ContainerStarted","Data":"1f5d02f86a5da390e55ca1375289ab46c8800a6cecc944eb3ff4477e8deb504a"}
Nov 01 03:41:48.861703 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.861682    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k" event={"ID":"939fc194-d0cf-4ee7-8db2-bcf14992affc","Type":"ContainerStarted","Data":"9d5afb45a99d26bb448a850d023b29dedd5ec2a0c019396fc455024da185e683"}
Nov 01 03:41:48.862761 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.862741    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gmh92" event={"ID":"ecef226e-8496-4a01-9903-2ecd046af47e","Type":"ContainerStarted","Data":"a4f4a60812e4e244788d4618b856c8c749008b4446b361cc8601fde946cfa3e1"}
Nov 01 03:41:48.863835 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.863816    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xmvl" event={"ID":"870f99e7-36f6-4e6e-b166-963313638a23","Type":"ContainerStarted","Data":"cbf92ef562d4f76747b684272d690a3926730aaba55208340a82419b95dda0a0"}
Nov 01 03:41:48.864874 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.864854    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f2vfp" event={"ID":"89d5aad3-0b99-49f0-802d-9312cfe33f8d","Type":"ContainerStarted","Data":"72a2df738f15356962d08fa34212eaf3c363be5155284a0c90a39236c6458ca3"}
Nov 01 03:41:48.865876 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.865858    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zthp4" event={"ID":"1ac79e70-8d1c-4673-aab0-8d8ad7d76880","Type":"ContainerStarted","Data":"b3a0ebba101cfd54e9bbbcc342150b52bc245084174577fa3dd30cb1196dc9eb"}
Nov 01 03:41:48.867049 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.867020    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"527cc793cecb8fc1eb028e2e485cfd1883a8ae4f42093c371a7d9eaafe0f3a4f"}
Nov 01 03:41:48.868209 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.868162    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bjkt7" event={"ID":"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4","Type":"ContainerStarted","Data":"ed20760fcc7c0a6da3c68bc93c5bb77352501f8ffe2695a9fdf332ab2f40e1ea"}
Nov 01 03:41:48.869178 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:48.869157    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dvks" event={"ID":"459de48d-02fa-4213-9351-85502d870f39","Type":"ContainerStarted","Data":"13187460c8f733ab1ccdf12b209de8248188b69ca5dbfe5a045bd3eaac2bc87c"}
Nov 01 03:41:49.080553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:49.080457    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-31 03:36:47 +0000 UTC" deadline="2028-05-04 06:51:31.728050137 +0000 UTC"
Nov 01 03:41:49.080553 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:49.080505    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13203h9m42.647547502s"
Nov 01 03:41:50.648505 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:50.648465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:50.648936 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:50.648516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:50.648936 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.648646    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:50.648936 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.648670    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:50.648936 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.648717    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret podName:c8c13245-bedc-4277-8989-8c585941e3c0 nodeName:}" failed. No retries permitted until 2026-11-01 03:41:54.648698168 +0000 UTC m=+9.406289539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret") pod "global-pull-secret-syncer-m67pw" (UID: "c8c13245-bedc-4277-8989-8c585941e3c0") : object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:50.648936 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.648744    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs podName:03fbd825-e35c-44be-9057-71b672a3ce15 nodeName:}" failed. No retries permitted until 2026-11-01 03:41:54.648733225 +0000 UTC m=+9.406324588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs") pod "network-metrics-daemon-gcqhv" (UID: "03fbd825-e35c-44be-9057-71b672a3ce15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:50.749998 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:50.749907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:50.750228 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.750098    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 01 03:41:50.750228 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.750134    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 01 03:41:50.750228 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.750150    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltsnx for pod openshift-network-diagnostics/network-check-target-wztb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:50.750447 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.750235    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx podName:30e6a857-4975-4101-9e1f-a860bd3fd3af nodeName:}" failed. No retries permitted until 2026-11-01 03:41:54.750190436 +0000 UTC m=+9.507781794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltsnx" (UniqueName: "kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx") pod "network-check-target-wztb4" (UID: "30e6a857-4975-4101-9e1f-a860bd3fd3af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:50.853998 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:50.853727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:50.853998 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.853870    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:41:50.853998 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:50.853933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:50.854425 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.854012    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:41:50.854425 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:50.854054    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:50.854425 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:50.854150    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:41:52.852985 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:52.852947    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:52.853618 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:52.853089    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:41:52.853618 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:52.853253    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:52.853618 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:52.853329    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:41:52.853618 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:52.853370    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:52.853618 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:52.853432    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:41:53.890956 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:53.890915    2580 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="d6b401d9982d54fb27714edba3836c8f49daad4860dc095c67e48527a89081a8" exitCode=0
Nov 01 03:41:53.891457 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:53.890971    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dvks" event={"ID":"459de48d-02fa-4213-9351-85502d870f39","Type":"ContainerDied","Data":"d6b401d9982d54fb27714edba3836c8f49daad4860dc095c67e48527a89081a8"}
Nov 01 03:41:53.893017 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:53.892991    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"67398c77b717adfae75e6234ca803488","Type":"ContainerStarted","Data":"8951a9720445a10df5c86cc32232562b425fba580ec629271a677bd84958ddf5"}
Nov 01 03:41:53.895125 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:53.895086    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k" event={"ID":"939fc194-d0cf-4ee7-8db2-bcf14992affc","Type":"ContainerStarted","Data":"b106300ea9853687931ccac4b6fbdf991d9048b688cfe227c64548b9a9f33e71"}
Nov 01 03:41:54.250444 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:54.250339    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal" podStartSLOduration=8.250314486 podStartE2EDuration="8.250314486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:41:54.245926011 +0000 UTC m=+9.003517388" watchObservedRunningTime="2026-11-01 03:41:54.250314486 +0000 UTC m=+9.007905861"
Nov 01 03:41:54.682728 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:54.682682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:54.682922 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:54.682797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:54.682922 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.682829    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:54.682922 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.682911    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret podName:c8c13245-bedc-4277-8989-8c585941e3c0 nodeName:}" failed. No retries permitted until 2026-11-01 03:42:02.682888996 +0000 UTC m=+17.440480380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret") pod "global-pull-secret-syncer-m67pw" (UID: "c8c13245-bedc-4277-8989-8c585941e3c0") : object "kube-system"/"original-pull-secret" not registered
Nov 01 03:41:54.682922 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.682921    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:54.683127 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.682965    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs podName:03fbd825-e35c-44be-9057-71b672a3ce15 nodeName:}" failed. No retries permitted until 2026-11-01 03:42:02.682950532 +0000 UTC m=+17.440541891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs") pod "network-metrics-daemon-gcqhv" (UID: "03fbd825-e35c-44be-9057-71b672a3ce15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:41:54.783498 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:54.783416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:54.783833 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.783557    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 01 03:41:54.783833 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.783575    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 01 03:41:54.783833 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.783584    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltsnx for pod openshift-network-diagnostics/network-check-target-wztb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:54.783833 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.783631    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx podName:30e6a857-4975-4101-9e1f-a860bd3fd3af nodeName:}" failed. No retries permitted until 2026-11-01 03:42:02.783619556 +0000 UTC m=+17.541210923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltsnx" (UniqueName: "kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx") pod "network-check-target-wztb4" (UID: "30e6a857-4975-4101-9e1f-a860bd3fd3af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:41:54.852995 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:54.852961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:54.853158 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:54.853005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:54.853158 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:54.852961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:54.853158 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.853084    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:41:54.853295 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.853188    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:41:54.853295 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:54.853247    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:41:54.901816 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:54.901772    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nb2ld" event={"ID":"40a71ede-b75a-4381-8299-49e46083e654","Type":"ContainerStarted","Data":"c452daa8400f055ca8a92f526a16d85960ba57596e04c739483d02a8cb2a5375"}
Nov 01 03:41:55.026651 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:55.026593    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-nb2ld" podStartSLOduration=2.9061605889999997 podStartE2EDuration="9.026572549s" totalImagesPullingTime="6.12041196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:41:55.02656398 +0000 UTC m=+9.784155404" watchObservedRunningTime="2026-11-01 03:41:55.026572549 +0000 UTC m=+9.784163925"
Nov 01 03:41:55.658740 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:55.658715    2580 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 01 03:41:55.683010 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:55.682269    2580 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-01T03:41:55.65873816Z","UUID":"a6a7562d-c155-4b36-bf64-0c5714239ba5","Handler":null,"Name":"","Endpoint":""}
Nov 01 03:41:55.685521 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:55.685485    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 01 03:41:55.685521 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:55.685515    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 01 03:41:55.906046 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:55.906007    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k" event={"ID":"939fc194-d0cf-4ee7-8db2-bcf14992affc","Type":"ContainerStarted","Data":"d29aaea6bea9815d450a34c4a1576cfe5d2af9f2a945056c10c9231279e36edf"}
Nov 01 03:41:56.853878 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:56.853053    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:56.853878 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:56.853193    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:41:56.853878 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:56.853610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:56.853878 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:56.853693    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:41:56.853878 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:56.853758    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:56.853878 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:56.853829    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:41:56.910918 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:56.910233    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f2vfp" event={"ID":"89d5aad3-0b99-49f0-802d-9312cfe33f8d","Type":"ContainerStarted","Data":"1ec5a5b637ed0c9135378c0723e5ed8854c324e2c5c875a117c78ca858ea53f9"}
Nov 01 03:41:56.914258 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:56.913819    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gmh92" event={"ID":"ecef226e-8496-4a01-9903-2ecd046af47e","Type":"ContainerStarted","Data":"e067c3060ccf42ce5e2aa988dc4d2ae9698333335b85b06539e0a8ca824eef05"}
Nov 01 03:41:57.154083 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:57.154022    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f2vfp" podStartSLOduration=3.42226228 podStartE2EDuration="11.154001429s" totalImagesPullingTime="7.731739149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:41:57.032340906 +0000 UTC m=+11.789932285" watchObservedRunningTime="2026-11-01 03:41:57.154001429 +0000 UTC m=+11.911592806"
Nov 01 03:41:58.853342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.853269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:41:58.853342 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.853300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:41:58.853844 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:58.853414    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:41:58.853844 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:58.853477    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:41:58.853844 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.853517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:41:58.853844 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:41:58.853626    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:41:58.919901 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.919867    2580 generic.go:356] "Generic (PLEG): container finished" podID="c462f6853597aa7799ac7948357b2573" containerID="4c8abe8cead383bf933e125c813f878698b62cbe0f12dfc1d527f79fd22dd999" exitCode=0
Nov 01 03:41:58.920081 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.919960    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"c462f6853597aa7799ac7948357b2573","Type":"ContainerDied","Data":"4c8abe8cead383bf933e125c813f878698b62cbe0f12dfc1d527f79fd22dd999"}
Nov 01 03:41:58.922391 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.922364    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k" event={"ID":"939fc194-d0cf-4ee7-8db2-bcf14992affc","Type":"ContainerStarted","Data":"56df492f17de5df9a0c1d4eccf44bd2a59108123b1af90b15f62572ea3535c9b"}
Nov 01 03:41:58.924370 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.924279    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zthp4" event={"ID":"1ac79e70-8d1c-4673-aab0-8d8ad7d76880","Type":"ContainerStarted","Data":"49e4f66e45af79e9acb16da00d8d4f371bfedec1f3e48ab119b9ddc0e6ec35e4"}
Nov 01 03:41:58.981127 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.980491    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:58.981658 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:58.981621    2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:41:59.041056 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:59.041005    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gmh92" podStartSLOduration=4.592211225 podStartE2EDuration="13.040990793s" totalImagesPullingTime="8.448779568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:41:57.154401073 +0000 UTC m=+11.911992459" watchObservedRunningTime="2026-11-01 03:41:59.040990793 +0000 UTC m=+13.798582169"
Nov 01 03:41:59.162043 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:59.161850    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-zthp4" podStartSLOduration=3.053878312 podStartE2EDuration="13.161838074s" totalImagesPullingTime="10.107959762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:41:59.161505794 +0000 UTC m=+13.919097170" watchObservedRunningTime="2026-11-01 03:41:59.161838074 +0000 UTC m=+13.919429450"
Nov 01 03:41:59.412145 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:59.411440    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k" podStartSLOduration=4.030928569 podStartE2EDuration="13.411423777s" totalImagesPullingTime="9.380495208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:41:59.287620984 +0000 UTC m=+14.045212360" watchObservedRunningTime="2026-11-01 03:41:59.411423777 +0000 UTC m=+14.169015153"
Nov 01 03:41:59.927938 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:59.927812    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9xmvl" event={"ID":"870f99e7-36f6-4e6e-b166-963313638a23","Type":"ContainerStarted","Data":"21091191bc0341791d1e1ebf6da78ff68957defb0ed4aab02be167a0f6164886"}
Nov 01 03:41:59.929709 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:59.929684    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"c462f6853597aa7799ac7948357b2573","Type":"ContainerStarted","Data":"4a173ef637de9dc4636bcc5ceb33ca6ee11e25ed02edb73815064efec949bcc7"}
Nov 01 03:41:59.931486 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:59.931460    2580 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="ed3374182b65e9e629fbfd3fe0d84b04b7c531342ab47d7e2d2e2d9499b3bcbb" exitCode=0
Nov 01 03:41:59.931594 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:59.931547    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dvks" event={"ID":"459de48d-02fa-4213-9351-85502d870f39","Type":"ContainerDied","Data":"ed3374182b65e9e629fbfd3fe0d84b04b7c531342ab47d7e2d2e2d9499b3bcbb"}
Nov 01 03:41:59.995116 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:41:59.995076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:00.053859 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.053806    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9xmvl" podStartSLOduration=2.6623935899999998 podStartE2EDuration="14.053790361s" totalImagesPullingTime="11.391396771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:00.053475791 +0000 UTC m=+14.811067177" watchObservedRunningTime="2026-11-01 03:42:00.053790361 +0000 UTC m=+14.811381740"
Nov 01 03:42:00.174428 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.174369    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal" podStartSLOduration=14.174355035 podStartE2EDuration="14.174355035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:00.174303051 +0000 UTC m=+14.931894424" watchObservedRunningTime="2026-11-01 03:42:00.174355035 +0000 UTC m=+14.931946411"
Nov 01 03:42:00.262509 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.262458    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:00.463945 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.463918    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:42:00.464602 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.464579    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:42:00.716444 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.716414    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:00.852730 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.852700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:00.852911 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.852754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:00.852911 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:00.852849    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:00.852911 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.852905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:00.853028 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:00.852982    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:00.853068 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:00.853046    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:00.934709 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:00.934680    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bjkt7" event={"ID":"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4","Type":"ContainerStarted","Data":"35b81ee901b8f28b105dd995bb02560aefbcc061fd9348c38980c9a6ce084c91"}
Nov 01 03:42:01.056425 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:01.056336    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bjkt7" podStartSLOduration=4.478581389 podStartE2EDuration="15.056321688s" totalImagesPullingTime="10.577740299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:01.056239707 +0000 UTC m=+15.813831085" watchObservedRunningTime="2026-11-01 03:42:01.056321688 +0000 UTC m=+15.813913064"
Nov 01 03:42:01.938727 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:01.938688    2580 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="c6f9759f644924953aae3c85b338d04c6cb16d32eef547c2407418577362ab02" exitCode=0
Nov 01 03:42:01.939357 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:01.938773    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dvks" event={"ID":"459de48d-02fa-4213-9351-85502d870f39","Type":"ContainerDied","Data":"c6f9759f644924953aae3c85b338d04c6cb16d32eef547c2407418577362ab02"}
Nov 01 03:42:02.745298 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:02.745261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:02.745298 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:02.745306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:02.745483 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.745410    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 01 03:42:02.745483 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.745414    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:42:02.745483 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.745462    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret podName:c8c13245-bedc-4277-8989-8c585941e3c0 nodeName:}" failed. No retries permitted until 2026-11-01 03:42:18.745449799 +0000 UTC m=+33.503041166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret") pod "global-pull-secret-syncer-m67pw" (UID: "c8c13245-bedc-4277-8989-8c585941e3c0") : object "kube-system"/"original-pull-secret" not registered
Nov 01 03:42:02.745483 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.745476    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs podName:03fbd825-e35c-44be-9057-71b672a3ce15 nodeName:}" failed. No retries permitted until 2026-11-01 03:42:18.745469433 +0000 UTC m=+33.503060786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs") pod "network-metrics-daemon-gcqhv" (UID: "03fbd825-e35c-44be-9057-71b672a3ce15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:42:02.846482 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:02.846444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:02.846647 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.846582    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 01 03:42:02.846647 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.846596    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 01 03:42:02.846647 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.846605    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltsnx for pod openshift-network-diagnostics/network-check-target-wztb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:42:02.846740 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.846650    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx podName:30e6a857-4975-4101-9e1f-a860bd3fd3af nodeName:}" failed. No retries permitted until 2026-11-01 03:42:18.846638857 +0000 UTC m=+33.604230224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltsnx" (UniqueName: "kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx") pod "network-check-target-wztb4" (UID: "30e6a857-4975-4101-9e1f-a860bd3fd3af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:42:02.853448 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:02.853424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:02.853568 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:02.853481    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:02.853568 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:02.853502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:02.853634 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.853572    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:02.853634 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.853616    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:02.853700 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:02.853688    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:03.694206 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:03.693959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:03.902352 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:03.902309    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:03.947565 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:03.947489    2580 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="bfb011d1ff8f6a2e213ef668c384e9e204daa95b8ee532f3a28f0d9ebc5a949c" exitCode=0
Nov 01 03:42:03.947565 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:03.947524    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dvks" event={"ID":"459de48d-02fa-4213-9351-85502d870f39","Type":"ContainerDied","Data":"bfb011d1ff8f6a2e213ef668c384e9e204daa95b8ee532f3a28f0d9ebc5a949c"}
Nov 01 03:42:04.281349 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:04.281270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:04.853277 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:04.853247    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:04.853738 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:04.853256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:04.853738 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:04.853404    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:04.853738 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:04.853368    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:04.853738 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:04.853484    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:04.853738 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:04.853564    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:05.891399 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:05.891363    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:06.099811 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:06.099777    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:06.304742 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:06.304648    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:06.852799 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:06.852762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:06.852991 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:06.852843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:06.852991 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:06.852946    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:06.853104 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:06.852980    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:06.853104 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:06.853026    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:06.853220 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:06.853092    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:07.308542 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:07.308503    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:07.563012 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:07.562876    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:07.773858 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:07.773784    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:08.125906 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:08.125877    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:08.853617 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:08.853585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:08.854060 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:08.853584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:08.854060 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:08.853688    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:08.854060 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:08.853787    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:08.854060 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:08.853591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:08.854060 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:08.853896    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:08.960453 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:08.960423    2580 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="57526ff33bb25dc0f35012fd69b9ed0c69f7738e75ad6c315fc57643c9d52db1" exitCode=0
Nov 01 03:42:08.960618 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:08.960471    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dvks" event={"ID":"459de48d-02fa-4213-9351-85502d870f39","Type":"ContainerDied","Data":"57526ff33bb25dc0f35012fd69b9ed0c69f7738e75ad6c315fc57643c9d52db1"}
Nov 01 03:42:09.681593 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:09.681560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:09.965797 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:09.965722    2580 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="9c47e9ace161cf2db63830f59bf816fcd7865b93a0ee743e6daa5a9346c61e13" exitCode=0
Nov 01 03:42:09.965797 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:09.965754    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dvks" event={"ID":"459de48d-02fa-4213-9351-85502d870f39","Type":"ContainerDied","Data":"9c47e9ace161cf2db63830f59bf816fcd7865b93a0ee743e6daa5a9346c61e13"}
Nov 01 03:42:10.092134 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:10.092101    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:10.299593 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:10.299509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:10.837000 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:10.836964    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:10.852961 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:10.852934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:10.853087 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:10.853043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:10.853087 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:10.853057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:10.853087 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:10.853063    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:10.853209 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:10.853115    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:10.853245 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:10.853220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:10.970864 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:10.970826    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8dvks" event={"ID":"459de48d-02fa-4213-9351-85502d870f39","Type":"ContainerStarted","Data":"1025aa28c7a164faac3cb89e094d8dbe27ed48ba94a6150523f58169b95bf970"}
Nov 01 03:42:11.100391 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:11.100273    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8dvks" podStartSLOduration=7.746256918 podStartE2EDuration="25.100258666s" totalImagesPullingTime="17.354001748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:11.099506763 +0000 UTC m=+25.857098136" watchObservedRunningTime="2026-11-01 03:42:11.100258666 +0000 UTC m=+25.857850039"
Nov 01 03:42:11.438914 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:11.438879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:11.643682 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:11.643643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:12.034237 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:12.034204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:12.242204 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:12.242154    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:12.844338 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:12.844310    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:12.853178 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:12.853142    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:12.853295 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:12.853255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:12.853295 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:12.853261    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:12.853295 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:12.853279    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:12.853393 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:12.853351    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:12.853426 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:12.853413    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:13.046226 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:13.046184    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:13.254550 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:13.254508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:13.454754 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:13.454722    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:13.655926 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:13.655893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:13.858107 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:13.858066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:14.227895 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:14.227858    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:14.739654 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:14.739619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:14.852868 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:14.852843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:14.853025 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:14.852909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:14.853025 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:14.852999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:14.853025 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:14.853010    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:14.853141 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:14.853077    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:14.853141 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:14.853111    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:14.948427 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:14.948394    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:15.150176 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:15.150142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:15.441347 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:15.441254    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:15.650858 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:15.650829    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:15.851321 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:15.851235    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:16.080743 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:16.080710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:16.287518 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:16.287483    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:16.830752 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:16.830713    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:16.852795 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:16.852763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:16.852921 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:16.852863    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:16.852921 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:16.852871    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:16.852921 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:16.852914    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:16.853037 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:16.852999    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:16.853081 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:16.853063    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:17.433073 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:17.433034    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:17.635038 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:17.635003    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:18.031961 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.031924    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:18.234310 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.234271    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:18.696384 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.696352    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:18.761428 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.761398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:18.761428 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.761431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:18.761627 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.761549    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 01 03:42:18.761627 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.761552    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:42:18.761627 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.761599    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret podName:c8c13245-bedc-4277-8989-8c585941e3c0 nodeName:}" failed. No retries permitted until 2026-11-01 03:42:50.761585461 +0000 UTC m=+65.519176828 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret") pod "global-pull-secret-syncer-m67pw" (UID: "c8c13245-bedc-4277-8989-8c585941e3c0") : object "kube-system"/"original-pull-secret" not registered
Nov 01 03:42:18.761627 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.761615    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs podName:03fbd825-e35c-44be-9057-71b672a3ce15 nodeName:}" failed. No retries permitted until 2026-11-01 03:42:50.761608019 +0000 UTC m=+65.519199374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs") pod "network-metrics-daemon-gcqhv" (UID: "03fbd825-e35c-44be-9057-71b672a3ce15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 01 03:42:18.853623 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.853593    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:18.853775 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.853656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:18.853775 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.853745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:18.853775 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.853750    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:18.853870 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.853840    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:18.853927 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.853912    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:18.861716 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.861692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:18.861852 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.861838    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 01 03:42:18.861886 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.861858    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 01 03:42:18.861886 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.861867    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltsnx for pod openshift-network-diagnostics/network-check-target-wztb4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:42:18.861993 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:18.861906    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx podName:30e6a857-4975-4101-9e1f-a860bd3fd3af nodeName:}" failed. No retries permitted until 2026-11-01 03:42:50.86189376 +0000 UTC m=+65.619485129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltsnx" (UniqueName: "kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx") pod "network-check-target-wztb4" (UID: "30e6a857-4975-4101-9e1f-a860bd3fd3af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 01 03:42:18.894977 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:18.894937    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:19.099795 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:19.099728    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:19.301269 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:19.301230    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:19.502626 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:19.502597    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:19.701311 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:19.701275    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:19.991701 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:19.991667    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:20.193120 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:20.193089    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:20.393388 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:20.393357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:20.628216 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:20.628181    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:20.838984 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:20.838901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:20.852837 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:20.852814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:20.852918 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:20.852853    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:20.852918 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:20.852912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:20.853000 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:20.852923    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:20.853000 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:20.852988    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:20.853098 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:20.853059    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:22.853474 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:22.853424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:22.853869 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:22.853450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:22.853869 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:22.853539    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:22.853869 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:22.853568    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:22.853869 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:22.853668    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:22.853869 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:22.853715    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:24.853471 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:24.853437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:24.853471 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:24.853458    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:24.854008 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:24.853437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:24.854008 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:24.853564    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:24.854008 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:24.853627    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:24.854008 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:24.853709    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:26.576362 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:26.576328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:26.787089 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:26.787058    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:26.853673 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:26.853594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:26.853830 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:26.853673    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:26.853830 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:26.853692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:26.853830 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:26.853778    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:26.853967 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:26.853856    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:26.853967 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:26.853926    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:27.094585 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:27.094553    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:27.297510 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:27.297475    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:27.885499 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:27.885465    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:28.295531 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:28.295448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:28.853503 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:28.853471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:28.853503 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:28.853509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:28.853725 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:28.853589    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:28.853725 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:28.853642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:28.853812 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:28.853734    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:28.853911 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:28.853884    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:30.243565 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:30.243410    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:30.443399 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:30.443374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:30.497766 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:30.497742    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zthp4_1ac79e70-8d1c-4673-aab0-8d8ad7d76880/dns-node-resolver/0.log"
Nov 01 03:42:30.583958 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:30.583934    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zthp4_1ac79e70-8d1c-4673-aab0-8d8ad7d76880/dns-node-resolver/0.log"
Nov 01 03:42:30.853034 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:30.852956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:30.853034 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:30.852984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:30.853245 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:30.853056    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:30.853245 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:30.853085    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:30.853245 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:30.853145    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:30.853245 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:30.853231    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:31.013114 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:31.013081    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"d1925020857fff45ddecd04359c7e13684580b8b71e750846ca6b35fbc5ab91d"}
Nov 01 03:42:31.013292 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:31.013152    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"95d46fcf15a2d71139cc0aeae2df8a05bc282550f06cf8a5436723bfd5f2f1be"}
Nov 01 03:42:31.013292 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:31.013198    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"5bbb1318d6b0bbe2f0c5f43e74a6c86e8d5d8d2e3a0c827243aca29f1f160662"}
Nov 01 03:42:31.013292 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:31.013236    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"32b458dc67ade3e83075d35b5151102bb4123a8eeaa91d4e44d506f3bb600e94"}
Nov 01 03:42:31.013292 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:31.013266    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"11b2b9197c90eb3f7bf99c1caa779c2a5fe11f46b083abdc84eb2f88fbbb006e"}
Nov 01 03:42:31.013422 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:31.013297    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"bef34d3a6362874aaf255fc7892ab0a416c38575c644c3c86afc197a8eba201b"}
Nov 01 03:42:31.234988 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:31.234960    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f2vfp_89d5aad3-0b99-49f0-802d-9312cfe33f8d/node-ca/0.log"
Nov 01 03:42:31.385530 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:31.385505    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f2vfp_89d5aad3-0b99-49f0-802d-9312cfe33f8d/node-ca/0.log"
Nov 01 03:42:32.853505 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:32.853425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:32.853852 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:32.853508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:32.853852 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:32.853616    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:32.853852 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:32.853621    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:32.853852 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:32.853677    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:32.853852 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:32.853726    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:33.019458 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:33.019426    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"6b6615835358eec777c2ed53285f104385ac3617eef1e7d6dbbddb505d1aa3a4"}
Nov 01 03:42:33.165395 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:33.165351    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:33.371255 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:33.371224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:33.573391 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:33.573304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:33.773375 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:33.773344    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:34.853350 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:34.853094    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:34.853350 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:34.853124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:34.853759 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:34.853360    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:34.853759 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:34.853157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:34.853759 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:34.853434    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:34.853759 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:34.853503    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:35.027337 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:35.027306    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" event={"ID":"ec9f5780-5d84-44be-bf3a-b3eb26d0808c","Type":"ContainerStarted","Data":"a0c1bd12b3c537374d02f7270462ac5028f83113f5f1cd79286072ab62c5978e"}
Nov 01 03:42:35.027625 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:35.027602    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:42:35.043664 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:35.043636    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:42:35.321510 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:35.321457    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7" podStartSLOduration=7.506374733 podStartE2EDuration="49.321443958s" totalImagesPullingTime="41.815069225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:35.321087705 +0000 UTC m=+50.078679083" watchObservedRunningTime="2026-11-01 03:42:35.321443958 +0000 UTC m=+50.079035374"
Nov 01 03:42:36.019446 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:36.019406    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:36.030104 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:36.030087    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:42:36.030299 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:36.030153    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:42:36.045410 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:36.045385    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:42:36.853464 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:36.853429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:36.853464 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:36.853457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:36.853720 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:36.853533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:36.853720 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:36.853543    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:36.853720 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:36.853631    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:36.853850 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:36.853731    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:37.271834 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:37.271801    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wztb4"]
Nov 01 03:42:37.272222 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:37.271901    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:37.272222 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:37.271987    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:37.272339 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:37.272319    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m67pw"]
Nov 01 03:42:37.272413 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:37.272402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:37.272491 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:37.272476    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:37.274508 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:37.274490    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gcqhv"]
Nov 01 03:42:37.274581 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:37.274572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:37.274652 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:37.274639    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:38.853445 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:38.853410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:38.853445 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:38.853453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:38.853898 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:38.853472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:38.853898 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:38.853578    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:38.853898 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:38.853643    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:38.853898 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:38.853693    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:40.039207 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:40.038994    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:42:40.039207 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:40.039180    2580 generic.go:356] "Generic (PLEG): container finished" podID="40a71ede-b75a-4381-8299-49e46083e654" containerID="c452daa8400f055ca8a92f526a16d85960ba57596e04c739483d02a8cb2a5375" exitCode=1
Nov 01 03:42:40.039575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:40.039207    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nb2ld" event={"ID":"40a71ede-b75a-4381-8299-49e46083e654","Type":"ContainerDied","Data":"c452daa8400f055ca8a92f526a16d85960ba57596e04c739483d02a8cb2a5375"}
Nov 01 03:42:40.039575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:40.039493    2580 scope.go:122] "RemoveContainer" containerID="c452daa8400f055ca8a92f526a16d85960ba57596e04c739483d02a8cb2a5375"
Nov 01 03:42:40.853494 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:40.853463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:40.853660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:40.853509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:40.853660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:40.853594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:40.853660 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:40.853594    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:40.853660 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:40.853650    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:40.853849 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:40.853720    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:40.903070 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:40.903037    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:41.046415 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:41.046342    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:42:41.046415 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:41.046410    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nb2ld" event={"ID":"40a71ede-b75a-4381-8299-49e46083e654","Type":"ContainerStarted","Data":"a619309735753a79055d25d5aaa1af34bbc7f168b458d8314cf350527335527c"}
Nov 01 03:42:41.524560 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:41.524528    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:41.724108 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:41.724076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:41.933895 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:41.933857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:42.141453 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.141419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:42.282750 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.282673    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rjnsj"]
Nov 01 03:42:42.285619 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.285605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.341735 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.341698    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 01 03:42:42.341735 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.341698    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 01 03:42:42.341937 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.341783    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 01 03:42:42.350947 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.350916    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:42.395138 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.395104    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 01 03:42:42.395138 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.395117    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 01 03:42:42.395364 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.395151    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 01 03:42:42.395364 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.395260    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ztkjl\""
Nov 01 03:42:42.427447 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-sys\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.427447 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-tls\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.427686 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-wtmp\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.427686 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-accelerators-collector-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.427686 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnf4d\" (UniqueName: \"kubernetes.io/projected/9b725795-a5f2-4b23-9429-d0bb34b56251-kube-api-access-cnf4d\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.427827 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.427827 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-textfile\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.427922 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-root\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.427922 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.427886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-metrics-client-ca\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528668 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-sys\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528668 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-tls\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528902 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-wtmp\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528902 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528749    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-sys\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528902 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528796    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-wtmp\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528902 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-accelerators-collector-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528902 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnf4d\" (UniqueName: \"kubernetes.io/projected/9b725795-a5f2-4b23-9429-d0bb34b56251-kube-api-access-cnf4d\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528902 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.528902 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-textfile\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.529243 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.528978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-root\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.529243 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.529009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-metrics-client-ca\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.529243 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.529098    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-root\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.529372 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.529293    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-textfile\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.529546 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.529513    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-accelerators-collector-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.529733 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.529717    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-metrics-client-ca\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.532556 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.532537    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.532667 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.532558    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-tls\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.563006 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.562937    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:42.593347 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.593314    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnf4d\" (UniqueName: \"kubernetes.io/projected/9b725795-a5f2-4b23-9429-d0bb34b56251-kube-api-access-cnf4d\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.603128 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.603108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:42:42.614090 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:42.614059    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b725795_a5f2_4b23_9429_d0bb34b56251.slice/crio-3a13f3a25b62a0b935fd16a306a7c1bcf96066e6c38ce3f8a66dce5e5613d6f0 WatchSource:0}: Error finding container 3a13f3a25b62a0b935fd16a306a7c1bcf96066e6c38ce3f8a66dce5e5613d6f0: Status 404 returned error can't find the container with id 3a13f3a25b62a0b935fd16a306a7c1bcf96066e6c38ce3f8a66dce5e5613d6f0
Nov 01 03:42:42.769703 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.769664    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:42.853322 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.853242    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:42.853322 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.853274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:42.853527 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.853330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:42.853527 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:42.853345    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wztb4" podUID="30e6a857-4975-4101-9e1f-a860bd3fd3af"
Nov 01 03:42:42.853527 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:42.853423    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gcqhv" podUID="03fbd825-e35c-44be-9057-71b672a3ce15"
Nov 01 03:42:42.853527 ip-10-0-136-214 kubenswrapper[2580]: E1101 03:42:42.853491    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m67pw" podUID="c8c13245-bedc-4277-8989-8c585941e3c0"
Nov 01 03:42:42.975796 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.975766    2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeReady"
Nov 01 03:42:42.975955 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:42.975902    2580 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 01 03:42:43.051373 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.051341    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rjnsj" event={"ID":"9b725795-a5f2-4b23-9429-d0bb34b56251","Type":"ContainerStarted","Data":"3a13f3a25b62a0b935fd16a306a7c1bcf96066e6c38ce3f8a66dce5e5613d6f0"}
Nov 01 03:42:43.101903 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.101871    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-blgfn"]
Nov 01 03:42:43.105630 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.105579    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vvb6t"]
Nov 01 03:42:43.105750 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.105720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.108459 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.108441    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bdn62"]
Nov 01 03:42:43.108543 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.108510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:42:43.111623 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.111605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.140947 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.140923    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-blgfn"]
Nov 01 03:42:43.150867 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.150845    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vvb6t"]
Nov 01 03:42:43.164559 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.164536    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 01 03:42:43.164559 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.164536    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 01 03:42:43.164723 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.164654    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 01 03:42:43.165337 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.165319    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 01 03:42:43.165337 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.165334    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-2mnqj\""
Nov 01 03:42:43.165552 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.165417    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jx8x8\""
Nov 01 03:42:43.165552 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.165507    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 01 03:42:43.166123 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.166103    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bdn62"]
Nov 01 03:42:43.166887 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.166873    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 01 03:42:43.166946 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.166901    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8fn5p\""
Nov 01 03:42:43.218557 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.218532    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 01 03:42:43.233747 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.233718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6386826-fe0a-4315-9714-4b107789df4f-metrics-tls\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.233747 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.233747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.233943 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.233863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzhzh\" (UniqueName: \"kubernetes.io/projected/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-kube-api-access-fzhzh\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:42:43.233943 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.233898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/813ebd55-ce29-4fde-931b-bd632c1b3658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.234013 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.233969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/813ebd55-ce29-4fde-931b-bd632c1b3658-crio-socket\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.234013 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.234009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/813ebd55-ce29-4fde-931b-bd632c1b3658-data-volume\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.234086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.234029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r7n4\" (UniqueName: \"kubernetes.io/projected/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-api-access-6r7n4\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.234086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.234050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stbsr\" (UniqueName: \"kubernetes.io/projected/c6386826-fe0a-4315-9714-4b107789df4f-kube-api-access-stbsr\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.234086 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.234072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-cert\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:42:43.234240 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.234135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6386826-fe0a-4315-9714-4b107789df4f-config-volume\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.234240 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.234198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6386826-fe0a-4315-9714-4b107789df4f-tmp-dir\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.265543 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.265515    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 01 03:42:43.265685 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.265548    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 01 03:42:43.335061 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/813ebd55-ce29-4fde-931b-bd632c1b3658-data-volume\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.335061 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7n4\" (UniqueName: \"kubernetes.io/projected/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-api-access-6r7n4\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.335330 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbsr\" (UniqueName: \"kubernetes.io/projected/c6386826-fe0a-4315-9714-4b107789df4f-kube-api-access-stbsr\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.335330 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-cert\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:42:43.335330 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6386826-fe0a-4315-9714-4b107789df4f-config-volume\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.335330 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6386826-fe0a-4315-9714-4b107789df4f-tmp-dir\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.335330 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6386826-fe0a-4315-9714-4b107789df4f-metrics-tls\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.335556 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.335556 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzhzh\" (UniqueName: \"kubernetes.io/projected/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-kube-api-access-fzhzh\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:42:43.335556 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/813ebd55-ce29-4fde-931b-bd632c1b3658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.335556 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/813ebd55-ce29-4fde-931b-bd632c1b3658-crio-socket\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.335556 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335514    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/813ebd55-ce29-4fde-931b-bd632c1b3658-data-volume\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.335556 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6386826-fe0a-4315-9714-4b107789df4f-tmp-dir\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.335837 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335623    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/813ebd55-ce29-4fde-931b-bd632c1b3658-crio-socket\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.335837 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.335820    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6386826-fe0a-4315-9714-4b107789df4f-config-volume\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.336032 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.336012    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.337656 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.337641    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6386826-fe0a-4315-9714-4b107789df4f-metrics-tls\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.337715 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.337675    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/813ebd55-ce29-4fde-931b-bd632c1b3658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.337821 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.337804    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-cert\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:42:43.399733 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.399702    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r7n4\" (UniqueName: \"kubernetes.io/projected/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-api-access-6r7n4\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.399865 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.399770    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbsr\" (UniqueName: \"kubernetes.io/projected/c6386826-fe0a-4315-9714-4b107789df4f-kube-api-access-stbsr\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.399910 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.399877    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzhzh\" (UniqueName: \"kubernetes.io/projected/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-kube-api-access-fzhzh\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:42:43.420857 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.420836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:43.423942 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.423926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:42:43.433714 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.433565    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:42:43.699264 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.699148    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:43.866040 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.866019    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vvb6t"]
Nov 01 03:42:43.869559 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:43.869155    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1db98a7_0a5c_498d_9682_4ec8cf74ddfb.slice/crio-581db867311109d850de4595ae38ac1262e28c30e0780806dc78b40dab7f02d8 WatchSource:0}: Error finding container 581db867311109d850de4595ae38ac1262e28c30e0780806dc78b40dab7f02d8: Status 404 returned error can't find the container with id 581db867311109d850de4595ae38ac1262e28c30e0780806dc78b40dab7f02d8
Nov 01 03:42:43.869781 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.869710    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-blgfn"]
Nov 01 03:42:43.870679 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.870659    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bdn62"]
Nov 01 03:42:43.874458 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:43.874298    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6386826_fe0a_4315_9714_4b107789df4f.slice/crio-b01647a0b2026d1c82a90d1803ade11e830be1b7482be84dd8a720092fce4be9 WatchSource:0}: Error finding container b01647a0b2026d1c82a90d1803ade11e830be1b7482be84dd8a720092fce4be9: Status 404 returned error can't find the container with id b01647a0b2026d1c82a90d1803ade11e830be1b7482be84dd8a720092fce4be9
Nov 01 03:42:43.874681 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:43.874629    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813ebd55_ce29_4fde_931b_bd632c1b3658.slice/crio-14484256ddd47ccaeb05aefd3f347ae63c9a1408bba510952877feb587101e5e WatchSource:0}: Error finding container 14484256ddd47ccaeb05aefd3f347ae63c9a1408bba510952877feb587101e5e: Status 404 returned error can't find the container with id 14484256ddd47ccaeb05aefd3f347ae63c9a1408bba510952877feb587101e5e
Nov 01 03:42:43.959911 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:43.959880    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:44.058128 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.058091    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bdn62" event={"ID":"813ebd55-ce29-4fde-931b-bd632c1b3658","Type":"ContainerStarted","Data":"10edd1c879ff2c97a67e5e53da5abb7da908633533bc7fda2e991e011000e1da"}
Nov 01 03:42:44.058292 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.058214    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bdn62" event={"ID":"813ebd55-ce29-4fde-931b-bd632c1b3658","Type":"ContainerStarted","Data":"14484256ddd47ccaeb05aefd3f347ae63c9a1408bba510952877feb587101e5e"}
Nov 01 03:42:44.059362 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.059333    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vvb6t" event={"ID":"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb","Type":"ContainerStarted","Data":"581db867311109d850de4595ae38ac1262e28c30e0780806dc78b40dab7f02d8"}
Nov 01 03:42:44.060443 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.060425    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blgfn" event={"ID":"c6386826-fe0a-4315-9714-4b107789df4f","Type":"ContainerStarted","Data":"b01647a0b2026d1c82a90d1803ade11e830be1b7482be84dd8a720092fce4be9"}
Nov 01 03:42:44.167366 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.167315    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:44.517240 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.517209    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 01 03:42:44.520528 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.520514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.524668 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.524636    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:44.577468 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.577433    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 01 03:42:44.577468 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.577433    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 01 03:42:44.630105 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.630072    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 01 03:42:44.630291 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.630280    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 01 03:42:44.630355 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.630317    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 01 03:42:44.630355 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.630353    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 01 03:42:44.630444 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.630352    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8bv72\""
Nov 01 03:42:44.630444 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.630389    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 01 03:42:44.630444 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.630396    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 01 03:42:44.631216 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.631196    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 01 03:42:44.644427 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-out\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644427 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-web-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644571 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644617 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644650 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-volume\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644650 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644717 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644717 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644793 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644793 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644858 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644890 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfbdw\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-kube-api-access-sfbdw\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.644928 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.644912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.685073 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.685044    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 01 03:42:44.745651 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745651 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfbdw\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-kube-api-access-sfbdw\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-out\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-web-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.745889 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.746320 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-volume\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.746320 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.745914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.748197 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.748087    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.749244 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.749119    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.749244 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.749201    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.751608 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.751535    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.751608 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.751541    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-web-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.751764 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.751610    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.751764 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.751727    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.751764 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.751741    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-volume\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.751917 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.751782    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.752105 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.752057    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.752105 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.752083    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.752851 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.752830    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-out\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.812907 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.812834    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfbdw\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-kube-api-access-sfbdw\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.844645 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.844604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:42:44.852781 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.852754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:44.852920 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.852781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:44.852920 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.852750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:44.853594 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.853016    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74f4d9d979-knqfv"]
Nov 01 03:42:44.856920 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.856896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:44.918575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.916715    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-v5dfc\""
Nov 01 03:42:44.918575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.916826    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-69w79\""
Nov 01 03:42:44.918575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.916956    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 01 03:42:44.918575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.916715    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 01 03:42:44.918575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.916894    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 01 03:42:44.918575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.916838    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-jzxr2\""
Nov 01 03:42:44.918575 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.917051    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 01 03:42:44.919041 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:44.919013    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74f4d9d979-knqfv"]
Nov 01 03:42:45.009453 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.009411    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 01 03:42:45.009453 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.009442    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 01 03:42:45.009453 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.009411    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 01 03:42:45.009453 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.009411    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 01 03:42:45.009790 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.009610    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s4zsm\""
Nov 01 03:42:45.009790 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.009668    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5q8kam09auued\""
Nov 01 03:42:45.009790 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.009733    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 01 03:42:45.048268 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.048413 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.048413 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-grpc-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.048509 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.048509 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj69v\" (UniqueName: \"kubernetes.io/projected/5f580cb7-edb1-4422-b86b-947fea4f1c5c-kube-api-access-zj69v\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.048581 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.048581 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f580cb7-edb1-4422-b86b-947fea4f1c5c-tmp\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.048642 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.048681 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.048643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f580cb7-edb1-4422-b86b-947fea4f1c5c-metrics-client-ca\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.149693 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.149663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.149693 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.149699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-grpc-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.149940 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.149734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.149940 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.149825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj69v\" (UniqueName: \"kubernetes.io/projected/5f580cb7-edb1-4422-b86b-947fea4f1c5c-kube-api-access-zj69v\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.149940 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.149874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.149940 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.149896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f580cb7-edb1-4422-b86b-947fea4f1c5c-tmp\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.150112 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.149953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.150112 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.149982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f580cb7-edb1-4422-b86b-947fea4f1c5c-metrics-client-ca\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.150112 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.150017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.150506 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.150479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f580cb7-edb1-4422-b86b-947fea4f1c5c-tmp\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.150820 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.150797    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f580cb7-edb1-4422-b86b-947fea4f1c5c-metrics-client-ca\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.153537 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.153510    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.153624 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.153558    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.153696 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.153678    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.154151 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.154129    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-grpc-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.154151 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.154146    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.154293 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.154146    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.214784 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.214753    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj69v\" (UniqueName: \"kubernetes.io/projected/5f580cb7-edb1-4422-b86b-947fea4f1c5c-kube-api-access-zj69v\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.219569 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.219543    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:45.294521 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.294488    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 01 03:42:45.322650 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:45.322617    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93da4576_fc49_4c08_8105_bcc0e81ea27a.slice/crio-4e1f6c8c36cef36939a09ec56a214cf6f34172962b3d1cadd67ffc8216175b03 WatchSource:0}: Error finding container 4e1f6c8c36cef36939a09ec56a214cf6f34172962b3d1cadd67ffc8216175b03: Status 404 returned error can't find the container with id 4e1f6c8c36cef36939a09ec56a214cf6f34172962b3d1cadd67ffc8216175b03
Nov 01 03:42:45.618986 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.618967    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74f4d9d979-knqfv"]
Nov 01 03:42:45.620664 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:45.620637    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f580cb7_edb1_4422_b86b_947fea4f1c5c.slice/crio-c635f584c6c881bc86ee65dcd08ac3ec7465ba5329b8a70dda08e535f197fd14 WatchSource:0}: Error finding container c635f584c6c881bc86ee65dcd08ac3ec7465ba5329b8a70dda08e535f197fd14: Status 404 returned error can't find the container with id c635f584c6c881bc86ee65dcd08ac3ec7465ba5329b8a70dda08e535f197fd14
Nov 01 03:42:45.830660 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:45.830473    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:46.066662 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.066623    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93da4576-fc49-4c08-8105-bcc0e81ea27a","Type":"ContainerStarted","Data":"4e1f6c8c36cef36939a09ec56a214cf6f34172962b3d1cadd67ffc8216175b03"}
Nov 01 03:42:46.068023 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.067992    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv" event={"ID":"5f580cb7-edb1-4422-b86b-947fea4f1c5c","Type":"ContainerStarted","Data":"c635f584c6c881bc86ee65dcd08ac3ec7465ba5329b8a70dda08e535f197fd14"}
Nov 01 03:42:46.069466 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.069444    2580 generic.go:356] "Generic (PLEG): container finished" podID="9b725795-a5f2-4b23-9429-d0bb34b56251" containerID="9b858463c5c5d326ebd11b8a6b3a70826f6510bb1baaca06a6b9eec2c45a7908" exitCode=0
Nov 01 03:42:46.069564 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.069506    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rjnsj" event={"ID":"9b725795-a5f2-4b23-9429-d0bb34b56251","Type":"ContainerDied","Data":"9b858463c5c5d326ebd11b8a6b3a70826f6510bb1baaca06a6b9eec2c45a7908"}
Nov 01 03:42:46.071273 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.071255    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bdn62" event={"ID":"813ebd55-ce29-4fde-931b-bd632c1b3658","Type":"ContainerStarted","Data":"b8ea44ac916a0ae3c3e8efedc78c25e84f1400999d00a48d7101f05581516f3a"}
Nov 01 03:42:46.084842 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.084812    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:46.507264 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.507227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:46.775037 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.774954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:46.960958 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.960927    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"]
Nov 01 03:42:46.964440 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:46.964411    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:47.001624 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.001592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:47.020195 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.019619    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"]
Nov 01 03:42:47.024244 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.024219    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b4lcx\""
Nov 01 03:42:47.024356 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.024285    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 01 03:42:47.064959 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.064875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlx2h\" (UniqueName: \"kubernetes.io/projected/2ca80b40-dc5f-479b-b73c-4683cd09c83a-kube-api-access-xlx2h\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:47.064959 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.064932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ca80b40-dc5f-479b-b73c-4683cd09c83a-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:47.077105 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.077075    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rjnsj" event={"ID":"9b725795-a5f2-4b23-9429-d0bb34b56251","Type":"ContainerStarted","Data":"89687f59929c86d22169bd3351dbadd8f60f2e9af5986412507e72e84008cc6d"}
Nov 01 03:42:47.077262 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.077131    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rjnsj" event={"ID":"9b725795-a5f2-4b23-9429-d0bb34b56251","Type":"ContainerStarted","Data":"b0b05923e708f9f7e7c4a58520f4cb4c9b34b3b1eeb12ff243d97d2d4bb47c1e"}
Nov 01 03:42:47.088149 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.088122    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86b5876bbc-85f92"]
Nov 01 03:42:47.091741 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.091721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.149868 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.149818    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 01 03:42:47.150015 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.149886    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cqurchiak8i88\""
Nov 01 03:42:47.150015 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.149965    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 01 03:42:47.150092 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.150036    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sbjbx\""
Nov 01 03:42:47.150124 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.150098    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 01 03:42:47.151567 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.151543    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86b5876bbc-85f92"]
Nov 01 03:42:47.165993 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.165955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlx2h\" (UniqueName: \"kubernetes.io/projected/2ca80b40-dc5f-479b-b73c-4683cd09c83a-kube-api-access-xlx2h\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:47.166150 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.166028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ca80b40-dc5f-479b-b73c-4683cd09c83a-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:47.169904 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.169881    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ca80b40-dc5f-479b-b73c-4683cd09c83a-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:47.221936 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.221865    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rjnsj" podStartSLOduration=2.669304058 podStartE2EDuration="5.221844348s" totalImagesPullingTime="2.47637155s" totalInitContainerRuntime="76.16874ms" isStatefulPod=true podCreationTimestamp="2026-11-01 03:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:47.22053191 +0000 UTC m=+61.978123334" watchObservedRunningTime="2026-11-01 03:42:47.221844348 +0000 UTC m=+61.979435708"
Nov 01 03:42:47.235195 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.233403    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlx2h\" (UniqueName: \"kubernetes.io/projected/2ca80b40-dc5f-479b-b73c-4683cd09c83a-kube-api-access-xlx2h\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:47.249347 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.249316    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 01 03:42:47.267184 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.267137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.267344 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.267302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5t6k\" (UniqueName: \"kubernetes.io/projected/5f4fd259-d210-48c2-a14a-d29656a3aa34-kube-api-access-d5t6k\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.267417 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.267364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-client-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.267515 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.267497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-metrics-server-audit-profiles\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.267572 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.267537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-client-certs\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.267651 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.267637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-tls\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.267708 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.267691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f4fd259-d210-48c2-a14a-d29656a3aa34-audit-log\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.278862 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.278836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:47.368710 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.368673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.368881 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.368824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5t6k\" (UniqueName: \"kubernetes.io/projected/5f4fd259-d210-48c2-a14a-d29656a3aa34-kube-api-access-d5t6k\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.368939 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.368883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-client-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.368988 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.368963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-metrics-server-audit-profiles\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.369035 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.369002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-client-certs\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.369085 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.369054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-tls\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.369131 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.369082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f4fd259-d210-48c2-a14a-d29656a3aa34-audit-log\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.369471 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.369450    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.369554 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.369470    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f4fd259-d210-48c2-a14a-d29656a3aa34-audit-log\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.370181 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.370116    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-metrics-server-audit-profiles\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.372532 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.372507    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-client-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.372628 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.372593    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-client-certs\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.378905 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.378864    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-tls\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.434421 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.434383    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5t6k\" (UniqueName: \"kubernetes.io/projected/5f4fd259-d210-48c2-a14a-d29656a3aa34-kube-api-access-d5t6k\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:47.665900 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.665734    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"]
Nov 01 03:42:47.668188 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:47.668148    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca80b40_dc5f_479b_b73c_4683cd09c83a.slice/crio-5b28f1b195f3027b6b65b5620221ad791d83675697ae9de2b192a5f23ad74ae5 WatchSource:0}: Error finding container 5b28f1b195f3027b6b65b5620221ad791d83675697ae9de2b192a5f23ad74ae5: Status 404 returned error can't find the container with id 5b28f1b195f3027b6b65b5620221ad791d83675697ae9de2b192a5f23ad74ae5
Nov 01 03:42:47.706545 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:47.706512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:42:48.082387 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:48.082346    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj" event={"ID":"2ca80b40-dc5f-479b-b73c-4683cd09c83a","Type":"ContainerStarted","Data":"5b28f1b195f3027b6b65b5620221ad791d83675697ae9de2b192a5f23ad74ae5"}
Nov 01 03:42:48.084811 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:48.084783    2580 generic.go:356] "Generic (PLEG): container finished" podID="93da4576-fc49-4c08-8105-bcc0e81ea27a" containerID="cbb71954bc72a14bf699437a73f7132128862fe1494a4098b85cf13aaa227dc3" exitCode=0
Nov 01 03:42:48.084965 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:48.084864    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93da4576-fc49-4c08-8105-bcc0e81ea27a","Type":"ContainerDied","Data":"cbb71954bc72a14bf699437a73f7132128862fe1494a4098b85cf13aaa227dc3"}
Nov 01 03:42:48.130275 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:48.130066    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86b5876bbc-85f92"]
Nov 01 03:42:48.133204 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:48.133144    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4fd259_d210_48c2_a14a_d29656a3aa34.slice/crio-17fd215d69b57bcffb141ac4f73960ab862a0c79c18878f3a85b46821ae0e2ab WatchSource:0}: Error finding container 17fd215d69b57bcffb141ac4f73960ab862a0c79c18878f3a85b46821ae0e2ab: Status 404 returned error can't find the container with id 17fd215d69b57bcffb141ac4f73960ab862a0c79c18878f3a85b46821ae0e2ab
Nov 01 03:42:48.236053 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:48.236019    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:48.691970 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:48.691934    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:48.945021 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:48.944988    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:49.091848 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:49.091341    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bdn62" event={"ID":"813ebd55-ce29-4fde-931b-bd632c1b3658","Type":"ContainerStarted","Data":"dbe5da9e05d76fc7eee86f7cb70b84a11922fc322b09cb227e26f7c29cba6b98"}
Nov 01 03:42:49.093521 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:49.093498    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92" event={"ID":"5f4fd259-d210-48c2-a14a-d29656a3aa34","Type":"ContainerStarted","Data":"17fd215d69b57bcffb141ac4f73960ab862a0c79c18878f3a85b46821ae0e2ab"}
Nov 01 03:42:49.095031 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:49.095000    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv" event={"ID":"5f580cb7-edb1-4422-b86b-947fea4f1c5c","Type":"ContainerStarted","Data":"958966cc4bfe12b45fff9ec9d1b9ad5dcf2d10068c01a9f244287ccd1f6b91b9"}
Nov 01 03:42:49.140055 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:49.140027    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:49.218225 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:49.218117    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bdn62" podStartSLOduration=1.693170936 podStartE2EDuration="6.218102922s" totalImagesPullingTime="4.524931986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 03:42:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:49.217496235 +0000 UTC m=+63.975087610" watchObservedRunningTime="2026-11-01 03:42:49.218102922 +0000 UTC m=+63.975694297"
Nov 01 03:42:49.411335 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:49.411298    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:49.609748 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:49.609676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:50.102507 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.102471    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv" event={"ID":"5f580cb7-edb1-4422-b86b-947fea4f1c5c","Type":"ContainerStarted","Data":"82798fb1b14c558ea068f6e62be08347234a4785649237fb734d86a1363d5cf8"}
Nov 01 03:42:50.102942 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.102562    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv" event={"ID":"5f580cb7-edb1-4422-b86b-947fea4f1c5c","Type":"ContainerStarted","Data":"7b865cf9195abee88ba547252f601d3717491991692398472cf9cabcbbf69bc0"}
Nov 01 03:42:50.182153 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.182111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:50.448479 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.448377    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:50.655549 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.655509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:50.797494 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.797442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:50.797494 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.797482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:50.898272 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.898209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:50.905947 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.905878    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 01 03:42:50.906100 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.905955    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 01 03:42:50.925659 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.912521    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:50.925659 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.920550    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:50.953457 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:50.953426    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 01 03:42:51.014365 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.014333    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 01 03:42:51.024516 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.024487    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:51.109788 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.109750    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92" event={"ID":"5f4fd259-d210-48c2-a14a-d29656a3aa34","Type":"ContainerStarted","Data":"93474e1663a6e7f554e5ee827cae6238561ab32166239b0dfd553061f65b770b"}
Nov 01 03:42:51.233718 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.233645    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-69w79\""
Nov 01 03:42:51.239631 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.239605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:42:51.287715 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.287689    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-v5dfc\""
Nov 01 03:42:51.288693 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.288654    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92" podStartSLOduration=2.088809606 podStartE2EDuration="4.288640991s" totalImagesPullingTime="2.199831385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:51.236375986 +0000 UTC m=+65.993967362" watchObservedRunningTime="2026-11-01 03:42:51.288640991 +0000 UTC m=+66.046232367"
Nov 01 03:42:51.289441 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.289421    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-jzxr2\""
Nov 01 03:42:51.294499 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.294476    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:51.295694 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.295677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:42:51.308023 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.307995    2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 01 03:42:51.314158 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.314101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.375073 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.374515    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 01 03:42:51.380217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.376989    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 01 03:42:51.380217 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.379245    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 01 03:42:51.385048 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.384843    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5lf5\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-kube-api-access-t5lf5\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403817    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.403980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.404003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.404026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.404052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.404583 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.404077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.405489 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.404111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.405489 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.404147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.405489 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.404203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.405489 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.404231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.483214 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.482022    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 01 03:42:51.483214 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.482243    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 01 03:42:51.483214 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.482342    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8onkr4n7reobd\""
Nov 01 03:42:51.487271 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.486593    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 01 03:42:51.487271 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.486947    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tcptc\""
Nov 01 03:42:51.487271 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.486993    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 01 03:42:51.487271 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.487053    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 01 03:42:51.487271 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.487121    2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 01 03:42:51.488198 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.487662    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 01 03:42:51.488198 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.487753    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 01 03:42:51.488198 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.487820    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 01 03:42:51.488198 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.487893    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 01 03:42:51.488198 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.488048    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 01 03:42:51.488198 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.488200    2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 01 03:42:51.506596 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506722 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506722 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506722 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506818 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506818 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506877 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5lf5\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-kube-api-access-t5lf5\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506877 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506934 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506934 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506998 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.506998 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.506979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.507054 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.507018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.507054 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.507048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.507150 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.507074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.507150 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.507101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.507150 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.507121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.507150 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.507147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.507294 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.507188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.507294 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.507221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.508703 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.508676    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.512829 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.509530    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.512829 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.510136    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.512829 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.510372    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.512829 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.511058    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.512829 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.511666    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.517588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.517648    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.518015    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.518525    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.519048    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.519284    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.519889    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.521301    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.521855    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.521954    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.529990 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.525582    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.530546 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.530022    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.531331 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.531263    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.575644 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.575611    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5lf5\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-kube-api-access-t5lf5\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.647220 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.647090    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gcqhv"]
Nov 01 03:42:51.658062 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:51.658033    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fbd825_e35c_44be_9057_71b672a3ce15.slice/crio-d30ffdaecdbe7b9349b7cbf431f0263f1f83da99fdd4d8922a16f20e1ce2ca8b WatchSource:0}: Error finding container d30ffdaecdbe7b9349b7cbf431f0263f1f83da99fdd4d8922a16f20e1ce2ca8b: Status 404 returned error can't find the container with id d30ffdaecdbe7b9349b7cbf431f0263f1f83da99fdd4d8922a16f20e1ce2ca8b
Nov 01 03:42:51.666675 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.666649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:42:51.709707 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.709682    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m67pw"]
Nov 01 03:42:51.711541 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:51.711510    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c13245_bedc_4277_8989_8c585941e3c0.slice/crio-82ece44ef0d9220debf93c153f976f180ad04300a0736e3ce47a7f250b58526a WatchSource:0}: Error finding container 82ece44ef0d9220debf93c153f976f180ad04300a0736e3ce47a7f250b58526a: Status 404 returned error can't find the container with id 82ece44ef0d9220debf93c153f976f180ad04300a0736e3ce47a7f250b58526a
Nov 01 03:42:51.752240 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:51.751556    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wztb4"]
Nov 01 03:42:51.755627 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:51.755591    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e6a857_4975_4101_9e1f_a860bd3fd3af.slice/crio-7737da0b70e5d7bf1f32cc6e5b64137159336fcefa002d95968f41b61b7dccf0 WatchSource:0}: Error finding container 7737da0b70e5d7bf1f32cc6e5b64137159336fcefa002d95968f41b61b7dccf0: Status 404 returned error can't find the container with id 7737da0b70e5d7bf1f32cc6e5b64137159336fcefa002d95968f41b61b7dccf0
Nov 01 03:42:52.075695 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.075669    2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 01 03:42:52.077630 ip-10-0-136-214 kubenswrapper[2580]: W1101 03:42:52.077602    2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd0c5f5_a794_4d20_b439_262ad4704f8a.slice/crio-48d03f922714f86f3d77b99a4be17cf42282012c31d07d3a776d5216e83daae7 WatchSource:0}: Error finding container 48d03f922714f86f3d77b99a4be17cf42282012c31d07d3a776d5216e83daae7: Status 404 returned error can't find the container with id 48d03f922714f86f3d77b99a4be17cf42282012c31d07d3a776d5216e83daae7
Nov 01 03:42:52.115982 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.115950    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv" event={"ID":"5f580cb7-edb1-4422-b86b-947fea4f1c5c","Type":"ContainerStarted","Data":"586534bc07ed619b23824bb7048e77e03e2476be7822c9048d064e11e3f2a1be"}
Nov 01 03:42:52.116411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.116025    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv" event={"ID":"5f580cb7-edb1-4422-b86b-947fea4f1c5c","Type":"ContainerStarted","Data":"0679b1b2b6a616ccba03ce8fdaf6b86b85c2114d16c98360e81bc7fe54ca0b56"}
Nov 01 03:42:52.116411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.116067    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv" event={"ID":"5f580cb7-edb1-4422-b86b-947fea4f1c5c","Type":"ContainerStarted","Data":"fd3fc99a0bf8675cb8a5a0ca40e1fb7262b7a617478d318982f2c5fbbed65b53"}
Nov 01 03:42:52.116411 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.116217    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:52.117265 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.117242    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wztb4" event={"ID":"30e6a857-4975-4101-9e1f-a860bd3fd3af","Type":"ContainerStarted","Data":"7737da0b70e5d7bf1f32cc6e5b64137159336fcefa002d95968f41b61b7dccf0"}
Nov 01 03:42:52.118782 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.118758    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj" event={"ID":"2ca80b40-dc5f-479b-b73c-4683cd09c83a","Type":"ContainerStarted","Data":"a47719e53315f834a3566d5db737953e47061067cef765c8f369da6938c3ff9b"}
Nov 01 03:42:52.119016 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.118983    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:52.120494 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.120473    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd0c5f5-a794-4d20-b439-262ad4704f8a","Type":"ContainerStarted","Data":"48d03f922714f86f3d77b99a4be17cf42282012c31d07d3a776d5216e83daae7"}
Nov 01 03:42:52.121684 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.121660    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m67pw" event={"ID":"c8c13245-bedc-4277-8989-8c585941e3c0","Type":"ContainerStarted","Data":"82ece44ef0d9220debf93c153f976f180ad04300a0736e3ce47a7f250b58526a"}
Nov 01 03:42:52.124693 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.124673    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:42:52.125757 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.125647    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93da4576-fc49-4c08-8105-bcc0e81ea27a","Type":"ContainerStarted","Data":"810413a2f4dede9b81a6fa28b548502215fb47ed77486578c67e77aa0e10ee0f"}
Nov 01 03:42:52.125757 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.125709    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93da4576-fc49-4c08-8105-bcc0e81ea27a","Type":"ContainerStarted","Data":"c4210c02acb7348966d803eb182f3a7abeb4cd2137ecdd614052bb7a2dbc440e"}
Nov 01 03:42:52.125887 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.125763    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93da4576-fc49-4c08-8105-bcc0e81ea27a","Type":"ContainerStarted","Data":"41afeaef45241d209297c2a7d536c249d8e24705c5455aaa61bba791c3658199"}
Nov 01 03:42:52.125887 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.125804    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93da4576-fc49-4c08-8105-bcc0e81ea27a","Type":"ContainerStarted","Data":"208439de774106d050befc39773948308238776dc4abf03ba8e07777af575b59"}
Nov 01 03:42:52.125887 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.125841    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93da4576-fc49-4c08-8105-bcc0e81ea27a","Type":"ContainerStarted","Data":"27a87fd0760f42d07fa05b07631d1bf56d0a42a4b2d0fb0d4514d089d102a3d5"}
Nov 01 03:42:52.126038 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.125886    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"93da4576-fc49-4c08-8105-bcc0e81ea27a","Type":"ContainerStarted","Data":"29341b9b8e6024f3c506026cbe130d02b3da16776285d3a678b42e568fb8d8bd"}
Nov 01 03:42:52.126862 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.126842    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gcqhv" event={"ID":"03fbd825-e35c-44be-9057-71b672a3ce15","Type":"ContainerStarted","Data":"d30ffdaecdbe7b9349b7cbf431f0263f1f83da99fdd4d8922a16f20e1ce2ca8b"}
Nov 01 03:42:52.246657 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.246607    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv" podStartSLOduration=2.347952546 podStartE2EDuration="8.246589459s" totalImagesPullingTime="5.898636913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:42:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:52.245986276 +0000 UTC m=+67.003577652" watchObservedRunningTime="2026-11-01 03:42:52.246589459 +0000 UTC m=+67.004180841"
Nov 01 03:42:52.368899 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.368779    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj" podStartSLOduration=2.346244012 podStartE2EDuration="6.368763208s" totalImagesPullingTime="4.022519196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:42:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:52.368513832 +0000 UTC m=+67.126105209" watchObservedRunningTime="2026-11-01 03:42:52.368763208 +0000 UTC m=+67.126354583"
Nov 01 03:42:52.505840 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:52.505784    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.13003308 podStartE2EDuration="8.505769536s" totalImagesPullingTime="5.360463105s" totalInitContainerRuntime="15.273351ms" isStatefulPod=false podCreationTimestamp="2026-11-01 03:42:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:52.504990672 +0000 UTC m=+67.262582048" watchObservedRunningTime="2026-11-01 03:42:52.505769536 +0000 UTC m=+67.263360903"
Nov 01 03:42:53.144499 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:53.144464    2580 generic.go:356] "Generic (PLEG): container finished" podID="8bd0c5f5-a794-4d20-b439-262ad4704f8a" containerID="2eaf94d305b95c2500c68745a573190d9f682127621ee71cb82269cf69c85a3c" exitCode=0
Nov 01 03:42:53.145077 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:53.144523    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bd0c5f5-a794-4d20-b439-262ad4704f8a","Type":"ContainerDied","Data":"2eaf94d305b95c2500c68745a573190d9f682127621ee71cb82269cf69c85a3c"}
Nov 01 03:42:53.396238 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:53.396121    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:53.652595 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:53.652491    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:54.151366 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:54.151341    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gcqhv" event={"ID":"03fbd825-e35c-44be-9057-71b672a3ce15","Type":"ContainerStarted","Data":"42d11b4ac734c7d5df0237f0eaddee1df94a09752f4f700fe78ca2624a72f93b"}
Nov 01 03:42:54.151679 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:54.151396    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gcqhv" event={"ID":"03fbd825-e35c-44be-9057-71b672a3ce15","Type":"ContainerStarted","Data":"3394210bce041bca5e1d0a187afb2e8c704d58fb14e32865d80bfed43ada15ec"}
Nov 01 03:42:54.278481 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:54.278425    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gcqhv" podStartSLOduration=66.461205207 podStartE2EDuration="1m8.278409221s" totalImagesPullingTime="1.817204014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:54.277434052 +0000 UTC m=+69.035025429" watchObservedRunningTime="2026-11-01 03:42:54.278409221 +0000 UTC m=+69.036000596"
Nov 01 03:42:55.160735 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:55.160695    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blgfn" event={"ID":"c6386826-fe0a-4315-9714-4b107789df4f","Type":"ContainerStarted","Data":"7b38315057d364045e2f5d0359e2d67282ee07df5c41ec657beb8f24d0061853"}
Nov 01 03:42:55.161199 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:55.160746    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blgfn" event={"ID":"c6386826-fe0a-4315-9714-4b107789df4f","Type":"ContainerStarted","Data":"44cdfe7294e1f25b32b9cedb59731882cf07db3e828724277ba2a4286d9d0c6c"}
Nov 01 03:42:55.161199 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:55.160800    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-blgfn"
Nov 01 03:42:55.285611 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:55.285088    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-blgfn" podStartSLOduration=2.096558201 podStartE2EDuration="12.285065722s" totalImagesPullingTime="10.188507521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:55.283400725 +0000 UTC m=+70.040992113" watchObservedRunningTime="2026-11-01 03:42:55.285065722 +0000 UTC m=+70.042657099"
Nov 01 03:42:55.359643 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:55.359551    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:55.601159 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:55.601059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:57.330347 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:57.330224    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:57.544525 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:57.544486    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:58.155644 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:58.155620    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:42:58.175678 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:58.175613    2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wztb4" event={"ID":"30e6a857-4975-4101-9e1f-a860bd3fd3af","Type":"ContainerStarted","Data":"64876ccdf03ede962e11fd585f040a56fe60dfd9abc4495195944d6a2834b244"}
Nov 01 03:42:58.175939 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:58.175922    2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:42:58.475369 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:58.475321    2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wztb4" podStartSLOduration=66.566591257 podStartE2EDuration="1m12.475303138s" totalImagesPullingTime="5.908711881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:42:58.472689765 +0000 UTC m=+73.230281143" watchObservedRunningTime="2026-11-01 03:42:58.475303138 +0000 UTC m=+73.232894519"
Nov 01 03:42:58.850901 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:58.850869    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:59.070002 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:59.069921    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:42:59.144634 ip-10-0-136-214 kubenswrapper[2580]: I1101 03:42:59.144471    2580 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 01 03:42:59.144635 ip-10-0-136-214 systemd[1]: Stopping Kubernetes Kubelet...
Nov 01 03:42:59.161650 ip-10-0-136-214 systemd[1]: kubelet.service: Deactivated successfully.
Nov 01 03:42:59.161847 ip-10-0-136-214 systemd[1]: Stopped Kubernetes Kubelet.
Nov 01 03:42:59.162048 ip-10-0-136-214 systemd[1]: kubelet.service: Consumed 4.439s CPU time.
Nov 01 03:42:59.177683 ip-10-0-136-214 systemd[1]: Starting Kubernetes Kubelet...
Nov 01 03:42:59.272056 ip-10-0-136-214 kubenswrapper[5529]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 01 03:42:59.272056 ip-10-0-136-214 kubenswrapper[5529]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 01 03:42:59.272056 ip-10-0-136-214 kubenswrapper[5529]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 01 03:42:59.272056 ip-10-0-136-214 kubenswrapper[5529]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 01 03:42:59.274583 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274488    5529 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:42:59.274583 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274580    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:42:59.274583 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274585    5529 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:42:59.274583 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274589    5529 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274593    5529 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274597    5529 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274601    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274605    5529 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274608    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274612    5529 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274616    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274620    5529 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274623    5529 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274627    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274631    5529 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274636    5529 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274640    5529 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274644    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274648    5529 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274651    5529 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274655    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274660    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274664    5529 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:42:59.274849 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274668    5529 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274672    5529 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274676    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274680    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274684    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274688    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274699    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274704    5529 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274708    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274713    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274717    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274721    5529 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274725    5529 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274730    5529 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274734    5529 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274738    5529 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274743    5529 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274747    5529 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274751    5529 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274755    5529 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:42:59.275698 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274759    5529 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274763    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274768    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274772    5529 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274779    5529 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274783    5529 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274787    5529 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274791    5529 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274796    5529 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274801    5529 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274806    5529 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274812    5529 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274816    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274821    5529 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274825    5529 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274829    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274834    5529 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274838    5529 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274843    5529 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:42:59.276565 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274847    5529 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274853    5529 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274857    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274862    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274866    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274870    5529 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274874    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274880    5529 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274884    5529 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274889    5529 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274893    5529 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274897    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274901    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274906    5529 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274910    5529 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274914    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274919    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274923    5529 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274928    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:42:59.277422 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274932    5529 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274936    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274941    5529 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274945    5529 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274950    5529 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274954    5529 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274959    5529 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274965    5529 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274971    5529 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274976    5529 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274981    5529 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274986    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274992    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.274997    5529 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275001    5529 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275005    5529 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275009    5529 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275014    5529 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275018    5529 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:42:59.278270 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275022    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275027    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275031    5529 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275039    5529 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275045    5529 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.275050    5529 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276389    5529 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276400    5529 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276406    5529 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276412    5529 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276416    5529 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276420    5529 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276425    5529 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276430    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276434    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276439    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276444    5529 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276449    5529 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276453    5529 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276457    5529 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:42:59.279089 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276462    5529 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276466    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276470    5529 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276474    5529 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276478    5529 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276485    5529 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276492    5529 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276497    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276502    5529 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276506    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276511    5529 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276515    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276519    5529 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276523    5529 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276527    5529 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276533    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276537    5529 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276541    5529 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276545    5529 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:42:59.280013 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276550    5529 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276554    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276559    5529 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276563    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276567    5529 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276572    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276576    5529 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276581    5529 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276585    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276589    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276594    5529 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276598    5529 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276603    5529 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276607    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276612    5529 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276616    5529 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276621    5529 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276625    5529 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276629    5529 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276633    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:42:59.280848 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276637    5529 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276641    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276646    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276650    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276654    5529 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276659    5529 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276663    5529 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276667    5529 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276671    5529 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276675    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276680    5529 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276684    5529 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276688    5529 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276693    5529 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276697    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276701    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276706    5529 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276710    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276714    5529 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276718    5529 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:42:59.281522 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276723    5529 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276728    5529 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276732    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276737    5529 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276741    5529 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276748    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276752    5529 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276756    5529 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276760    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276764    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276769    5529 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276773    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276777    5529 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276782    5529 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276787    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276793    5529 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276799    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276805    5529 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276810    5529 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:42:59.282018 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276815    5529 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276820    5529 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276824    5529 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276828    5529 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276833    5529 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276837    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276841    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276845    5529 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276850    5529 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276854    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276858    5529 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276869    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276873    5529 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.276878    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277785    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277796    5529 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277801    5529 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277807    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277812    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:42:59.282545 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277816    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277821    5529 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277826    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277830    5529 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277835    5529 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277840    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277844    5529 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277849    5529 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277853    5529 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277857    5529 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277862    5529 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277866    5529 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277870    5529 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277874    5529 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277878    5529 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277883    5529 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277887    5529 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277891    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277895    5529 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277900    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:42:59.283113 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277904    5529 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277909    5529 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277913    5529 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277917    5529 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277921    5529 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277925    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277929    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277942    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277947    5529 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277952    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277956    5529 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277960    5529 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277964    5529 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277969    5529 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277973    5529 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277980    5529 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277986    5529 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277991    5529 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.277999    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:42:59.283670 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278004    5529 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278008    5529 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278013    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278017    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278021    5529 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278025    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278029    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278033    5529 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278037    5529 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278042    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278046    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278050    5529 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278054    5529 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278060    5529 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278064    5529 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278069    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278072    5529 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278077    5529 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278081    5529 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278086    5529 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:42:59.284212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278090    5529 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278096    5529 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278101    5529 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278105    5529 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278109    5529 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278113    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278117    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278121    5529 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278125    5529 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278130    5529 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278134    5529 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278140    5529 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278144    5529 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278148    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278152    5529 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278175    5529 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278188    5529 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278194    5529 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278199    5529 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:42:59.284694 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278203    5529 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278208    5529 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278212    5529 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278217    5529 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278221    5529 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278226    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278230    5529 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278234    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278238    5529 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278242    5529 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278246    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278250    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278255    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278259    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278263    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278268    5529 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278273    5529 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278277    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278283    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278287    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:42:59.285155 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278291    5529 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278295    5529 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.278299    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278453    5529 flags.go:64] FLAG: --address="0.0.0.0"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278483    5529 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278498    5529 flags.go:64] FLAG: --anonymous-auth="true"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278505    5529 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278513    5529 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278518    5529 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278528    5529 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278534    5529 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278539    5529 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278544    5529 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278550    5529 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278555    5529 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278560    5529 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278565    5529 flags.go:64] FLAG: --cgroup-root=""
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278570    5529 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278575    5529 flags.go:64] FLAG: --client-ca-file=""
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278579    5529 flags.go:64] FLAG: --cloud-provider="external"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278584    5529 flags.go:64] FLAG: --cluster-dns="[]"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278590    5529 flags.go:64] FLAG: --cluster-domain=""
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278594    5529 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278600    5529 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 01 03:42:59.285662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278605    5529 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278610    5529 flags.go:64] FLAG: --container-log-max-files="5"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278617    5529 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278622    5529 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278627    5529 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278633    5529 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278638    5529 flags.go:64] FLAG: --contention-profiling="false"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278643    5529 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278647    5529 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278652    5529 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278657    5529 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278664    5529 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278672    5529 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278677    5529 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278682    5529 flags.go:64] FLAG: --enable-load-reader="false"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278687    5529 flags.go:64] FLAG: --enable-server="true"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278692    5529 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278706    5529 flags.go:64] FLAG: --event-burst="100"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278711    5529 flags.go:64] FLAG: --event-qps="50"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278716    5529 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278721    5529 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278726    5529 flags.go:64] FLAG: --eviction-hard=""
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278739    5529 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278743    5529 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278748    5529 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 01 03:42:59.286241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278753    5529 flags.go:64] FLAG: --eviction-soft=""
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278758    5529 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278763    5529 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278768    5529 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278772    5529 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278777    5529 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278783    5529 flags.go:64] FLAG: --fail-swap-on="true"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278788    5529 flags.go:64] FLAG: --feature-gates=""
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278794    5529 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278799    5529 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278805    5529 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278810    5529 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278816    5529 flags.go:64] FLAG: --healthz-port="10248"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278821    5529 flags.go:64] FLAG: --help="false"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278826    5529 flags.go:64] FLAG: --hostname-override="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278832    5529 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278837    5529 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278842    5529 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278847    5529 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278855    5529 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278860    5529 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278865    5529 flags.go:64] FLAG: --image-service-endpoint=""
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278869    5529 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 01 03:42:59.286849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278874    5529 flags.go:64] FLAG: --kube-api-burst="100"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278881    5529 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278886    5529 flags.go:64] FLAG: --kube-api-qps="50"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278891    5529 flags.go:64] FLAG: --kube-reserved=""
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278896    5529 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278900    5529 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278905    5529 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278910    5529 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278915    5529 flags.go:64] FLAG: --lock-file=""
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278919    5529 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278924    5529 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278929    5529 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278938    5529 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278943    5529 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278948    5529 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278952    5529 flags.go:64] FLAG: --logging-format="text"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278957    5529 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278962    5529 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278967    5529 flags.go:64] FLAG: --manifest-url=""
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278971    5529 flags.go:64] FLAG: --manifest-url-header=""
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278984    5529 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278989    5529 flags.go:64] FLAG: --max-open-files="1000000"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.278999    5529 flags.go:64] FLAG: --max-pods="110"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279004    5529 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279009    5529 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 01 03:42:59.287421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279014    5529 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279018    5529 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279023    5529 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279030    5529 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279035    5529 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279046    5529 flags.go:64] FLAG: --node-status-max-images="50"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279051    5529 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279056    5529 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279064    5529 flags.go:64] FLAG: --pod-cidr=""
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279069    5529 flags.go:64] FLAG: --pod-manifest-path=""
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279074    5529 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279079    5529 flags.go:64] FLAG: --pods-per-core="0"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279083    5529 flags.go:64] FLAG: --port="10250"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279088    5529 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279092    5529 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-096b4d7e9e6c5ca91"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279098    5529 flags.go:64] FLAG: --qos-reserved=""
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279102    5529 flags.go:64] FLAG: --read-only-port="10255"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279107    5529 flags.go:64] FLAG: --register-node="true"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279111    5529 flags.go:64] FLAG: --register-with-taints=""
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279117    5529 flags.go:64] FLAG: --registry-burst="10"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279122    5529 flags.go:64] FLAG: --registry-qps="5"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279127    5529 flags.go:64] FLAG: --reserved-cpus=""
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279132    5529 flags.go:64] FLAG: --reserved-memory=""
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279138    5529 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279143    5529 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279148    5529 flags.go:64] FLAG: --rotate-certificates="false"
Nov 01 03:42:59.288081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279153    5529 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279157    5529 flags.go:64] FLAG: --runonce="false"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279179    5529 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279184    5529 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279191    5529 flags.go:64] FLAG: --seccomp-default="false"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279196    5529 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279200    5529 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279205    5529 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279210    5529 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279217    5529 flags.go:64] FLAG: --storage-driver-password="root"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279222    5529 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279226    5529 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279231    5529 flags.go:64] FLAG: --storage-driver-user="root"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279236    5529 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279243    5529 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279248    5529 flags.go:64] FLAG: --system-cgroups=""
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279253    5529 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279263    5529 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279268    5529 flags.go:64] FLAG: --tls-cert-file=""
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279272    5529 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279279    5529 flags.go:64] FLAG: --tls-min-version=""
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279283    5529 flags.go:64] FLAG: --tls-private-key-file=""
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279288    5529 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279293    5529 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279298    5529 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 01 03:42:59.289110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279303    5529 flags.go:64] FLAG: --v="2"
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279310    5529 flags.go:64] FLAG: --version="false"
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279317    5529 flags.go:64] FLAG: --vmodule=""
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279323    5529 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.279328    5529 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279541    5529 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279548    5529 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279553    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279557    5529 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279561    5529 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279565    5529 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279570    5529 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279575    5529 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279579    5529 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279584    5529 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279588    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279595    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279599    5529 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279604    5529 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279608    5529 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:42:59.289995 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279612    5529 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279619    5529 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279625    5529 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279631    5529 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279638    5529 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279643    5529 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279647    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279652    5529 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279656    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279661    5529 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279665    5529 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279670    5529 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279674    5529 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279678    5529 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279683    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279687    5529 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279691    5529 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279696    5529 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279700    5529 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279704    5529 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:42:59.290576 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279709    5529 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279713    5529 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279717    5529 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279721    5529 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279726    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279731    5529 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279735    5529 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279740    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279746    5529 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279750    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279755    5529 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279760    5529 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279764    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279770    5529 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279774    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279778    5529 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279782    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279787    5529 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279791    5529 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279796    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:42:59.291223 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279800    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279804    5529 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279809    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279813    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279817    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279822    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279826    5529 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279830    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279834    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279838    5529 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279842    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279847    5529 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279851    5529 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279855    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279860    5529 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279864    5529 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279868    5529 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279873    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279878    5529 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:42:59.291804 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279882    5529 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279890    5529 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279894    5529 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279899    5529 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279903    5529 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279907    5529 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279913    5529 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279917    5529 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279922    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279926    5529 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279933    5529 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279939    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279945    5529 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279950    5529 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279954    5529 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279959    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279963    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279967    5529 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279972    5529 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:42:59.292408 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279976    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279980    5529 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279985    5529 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279990    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279994    5529 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.279998    5529 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280002    5529 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280006    5529 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280011    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280015    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280019    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280023    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280027    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.280068    5529 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280125    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280135    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:42:59.292866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280140    5529 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280145    5529 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280150    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280156    5529 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280178    5529 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280182    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280187    5529 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280191    5529 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280195    5529 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280199    5529 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280204    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280208    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280212    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280216    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280220    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280225    5529 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280229    5529 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280233    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280238    5529 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280242    5529 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:42:59.293268 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280246    5529 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280250    5529 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280255    5529 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280259    5529 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280263    5529 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280268    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280273    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280277    5529 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280281    5529 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280286    5529 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280291    5529 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280297    5529 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280302    5529 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280308    5529 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280314    5529 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280320    5529 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280325    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280329    5529 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280334    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:42:59.293751 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280338    5529 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280343    5529 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280347    5529 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280352    5529 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280356    5529 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280360    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280365    5529 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280369    5529 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280373    5529 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280377    5529 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280382    5529 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280386    5529 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280391    5529 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280395    5529 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280399    5529 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280404    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280408    5529 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280413    5529 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280417    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280422    5529 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:42:59.294220 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280426    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280431    5529 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280446    5529 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280451    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280464    5529 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280469    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280474    5529 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280478    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280484    5529 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280488    5529 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280493    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280497    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280501    5529 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280506    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280510    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280514    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280519    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280523    5529 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280528    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280532    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:42:59.294819 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280540    5529 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280545    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280549    5529 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280554    5529 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280558    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280562    5529 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280566    5529 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280571    5529 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280575    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280579    5529 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280584    5529 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280588    5529 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280592    5529 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280596    5529 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280600    5529 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280605    5529 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280611    5529 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280623    5529 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280627    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:42:59.295317 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280632    5529 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280642    5529 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280649    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280654    5529 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280659    5529 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.280663    5529 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.284699    5529 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.284718    5529 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.284737    5529 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.284742    5529 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284798    5529 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284803    5529 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284808    5529 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284812    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284816    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284819    5529 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284822    5529 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284825    5529 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:42:59.295770 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284827    5529 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284830    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284833    5529 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284836    5529 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284839    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284841    5529 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284844    5529 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284847    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284850    5529 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284853    5529 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284855    5529 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284858    5529 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284861    5529 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284863    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284866    5529 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284869    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284872    5529 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284874    5529 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284877    5529 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284880    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:42:59.296227 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284882    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284885    5529 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284888    5529 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284891    5529 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284893    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284896    5529 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284898    5529 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284901    5529 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284904    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284907    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284910    5529 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284912    5529 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284915    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284918    5529 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284920    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284923    5529 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284926    5529 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284928    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284931    5529 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:42:59.296701 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284934    5529 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284937    5529 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284939    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284942    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284945    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284947    5529 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284950    5529 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284953    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284955    5529 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284958    5529 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284960    5529 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284963    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284966    5529 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284969    5529 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284972    5529 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284975    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284977    5529 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284980    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284983    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284985    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:42:59.297153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284988    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284991    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284993    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284996    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.284999    5529 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285001    5529 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285004    5529 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285006    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285009    5529 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285011    5529 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285014    5529 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285017    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285019    5529 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285023    5529 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285025    5529 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285028    5529 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285030    5529 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285033    5529 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285036    5529 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285038    5529 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:42:59.297758 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285041    5529 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285043    5529 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285046    5529 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285049    5529 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285052    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285054    5529 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285057    5529 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285060    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285063    5529 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285067    5529 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285070    5529 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285073    5529 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285076    5529 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285079    5529 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285081    5529 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285084    5529 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285086    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285089    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:42:59.298467 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285091    5529 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.285120    5529 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285317    5529 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285323    5529 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285327    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285329    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285333    5529 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285336    5529 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285338    5529 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285341    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285344    5529 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285347    5529 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285349    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285352    5529 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285354    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285357    5529 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:42:59.299057 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285360    5529 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285362    5529 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285365    5529 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285367    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285370    5529 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285373    5529 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285375    5529 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285378    5529 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285381    5529 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285385    5529 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285387    5529 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285390    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285392    5529 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285395    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285398    5529 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285401    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285403    5529 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285406    5529 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285408    5529 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285411    5529 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:42:59.299471 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285413    5529 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285416    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285419    5529 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285421    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285423    5529 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285426    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285429    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285431    5529 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285434    5529 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285436    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285439    5529 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285441    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285444    5529 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285446    5529 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285449    5529 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285452    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285455    5529 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285458    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285460    5529 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:42:59.300025 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285463    5529 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285466    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285468    5529 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285472    5529 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285476    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285478    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285481    5529 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285483    5529 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285486    5529 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285488    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285491    5529 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285493    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285496    5529 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285500    5529 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285504    5529 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285507    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285510    5529 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285513    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285515    5529 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:42:59.300697 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285518    5529 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285521    5529 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285523    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285525    5529 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285528    5529 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285530    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285533    5529 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285535    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285538    5529 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285541    5529 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285543    5529 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285546    5529 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285549    5529 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285551    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285554    5529 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285557    5529 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285559    5529 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285562    5529 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285564    5529 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285567    5529 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:42:59.301178 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285569    5529 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285572    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285574    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285576    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285579    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285581    5529 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285587    5529 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285590    5529 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285592    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285596    5529 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285598    5529 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285601    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285603    5529 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285606    5529 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.285632    5529 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285666    5529 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 01 03:42:59.301669 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285670    5529 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285674    5529 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285677    5529 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285680    5529 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285683    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285685    5529 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285688    5529 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285690    5529 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285695    5529 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285698    5529 feature_gate.go:386] unrecognized feature gate: Example2
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285700    5529 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285703    5529 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285706    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285709    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285711    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285714    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285716    5529 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285719    5529 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285721    5529 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285724    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 01 03:42:59.302109 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285727    5529 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285729    5529 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285732    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285736    5529 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285738    5529 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285741    5529 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285744    5529 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285746    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285749    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285751    5529 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285754    5529 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285756    5529 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285759    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285761    5529 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285764    5529 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285767    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285769    5529 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285772    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285774    5529 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 01 03:42:59.302622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285777    5529 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285782    5529 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285784    5529 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285787    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285789    5529 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285792    5529 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285795    5529 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285798    5529 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285800    5529 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285803    5529 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285805    5529 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285808    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285811    5529 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285813    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285816    5529 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285819    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285824    5529 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285827    5529 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285829    5529 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285832    5529 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 01 03:42:59.303083 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285834    5529 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285837    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285839    5529 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285842    5529 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285844    5529 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285847    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285849    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285852    5529 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285855    5529 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285857    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285860    5529 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285863    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285865    5529 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285869    5529 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285872    5529 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285874    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285877    5529 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285879    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285882    5529 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 01 03:42:59.303622 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285885    5529 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285887    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285890    5529 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285894    5529 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285898    5529 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285901    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285904    5529 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285907    5529 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285910    5529 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285914    5529 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285916    5529 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285919    5529 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285921    5529 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285926    5529 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285929    5529 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285933    5529 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285936    5529 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285939    5529 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285942    5529 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 01 03:42:59.304081 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285945    5529 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285947    5529 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285950    5529 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285952    5529 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285955    5529 feature_gate.go:386] unrecognized feature gate: Example
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285958    5529 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285960    5529 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:42:59.285964    5529 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.286033    5529 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.287028    5529 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.287082    5529 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.287281    5529 server.go:1014] "Starting client certificate rotation"
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.287418    5529 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.287480    5529 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-31 03:36:46 +0000 UTC" deadline="2028-07-22 23:50:22.303843756 +0000 UTC"
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.287525    5529 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15116h7m23.016321717s"
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.287723    5529 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 01 03:42:59.304634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.290427    5529 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 01 03:42:59.305099 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.291722    5529 log.go:25] "Validated CRI v1 runtime API"
Nov 01 03:42:59.305099 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.293588    5529 log.go:25] "Validated CRI v1 image API"
Nov 01 03:42:59.305099 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.294326    5529 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 01 03:42:59.305099 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.296493    5529 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c1a1e22b-1a90-421c-a953-ecc8303a6ac3:/dev/nvme0n1p3 ef8d7415-c6c9-4eae-9a73-f11b2b1a36f1:/dev/nvme0n1p4]
Nov 01 03:42:59.305255 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.296515    5529 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/13187460c8f733ab1ccdf12b209de8248188b69ca5dbfe5a045bd3eaac2bc87c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/13187460c8f733ab1ccdf12b209de8248188b69ca5dbfe5a045bd3eaac2bc87c/userdata/shm major:0 minor:69 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/14484256ddd47ccaeb05aefd3f347ae63c9a1408bba510952877feb587101e5e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/14484256ddd47ccaeb05aefd3f347ae63c9a1408bba510952877feb587101e5e/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/17fd215d69b57bcffb141ac4f73960ab862a0c79c18878f3a85b46821ae0e2ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/17fd215d69b57bcffb141ac4f73960ab862a0c79c18878f3a85b46821ae0e2ab/userdata/shm major:0 minor:280 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1f5d02f86a5da390e55ca1375289ab46c8800a6cecc944eb3ff4477e8deb504a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1f5d02f86a5da390e55ca1375289ab46c8800a6cecc944eb3ff4477e8deb504a/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a13f3a25b62a0b935fd16a306a7c1bcf96066e6c38ce3f8a66dce5e5613d6f0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a13f3a25b62a0b935fd16a306a7c1bcf96066e6c38ce3f8a66dce5e5613d6f0/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/48d03f922714f86f3d77b99a4be17cf42282012c31d07d3a776d5216e83daae7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/48d03f922714f86f3d77b99a4be17cf42282012c31d07d3a776d5216e83daae7/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4e1f6c8c36cef36939a09ec56a214cf6f34172962b3d1cadd67ffc8216175b03/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4e1f6c8c36cef36939a09ec56a214cf6f34172962b3d1cadd67ffc8216175b03/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/527cc793cecb8fc1eb028e2e485cfd1883a8ae4f42093c371a7d9eaafe0f3a4f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/527cc793cecb8fc1eb028e2e485cfd1883a8ae4f42093c371a7d9eaafe0f3a4f/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/581db867311109d850de4595ae38ac1262e28c30e0780806dc78b40dab7f02d8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/581db867311109d850de4595ae38ac1262e28c30e0780806dc78b40dab7f02d8/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5b28f1b195f3027b6b65b5620221ad791d83675697ae9de2b192a5f23ad74ae5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5b28f1b195f3027b6b65b5620221ad791d83675697ae9de2b192a5f23ad74ae5/userdata/shm major:0 minor:272 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/72a2df738f15356962d08fa34212eaf3c363be5155284a0c90a39236c6458ca3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/72a2df738f15356962d08fa34212eaf3c363be5155284a0c90a39236c6458ca3/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7737da0b70e5d7bf1f32cc6e5b64137159336fcefa002d95968f41b61b7dccf0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7737da0b70e5d7bf1f32cc6e5b64137159336fcefa002d95968f41b61b7dccf0/userdata/shm major:0 minor:318 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/82ece44ef0d9220debf93c153f976f180ad04300a0736e3ce47a7f250b58526a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/82ece44ef0d9220debf93c153f976f180ad04300a0736e3ce47a7f250b58526a/userdata/shm major:0 minor:320 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8759f3f175e1411f59cd84a0da382512473c30cb06797d190d905b7a9d96464c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8759f3f175e1411f59cd84a0da382512473c30cb06797d190d905b7a9d96464c/userdata/shm major:0 minor:64 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9d5afb45a99d26bb448a850d023b29dedd5ec2a0c019396fc455024da185e683/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9d5afb45a99d26bb448a850d023b29dedd5ec2a0c019396fc455024da185e683/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a4f4a60812e4e244788d4618b856c8c749008b4446b361cc8601fde946cfa3e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a4f4a60812e4e244788d4618b856c8c749008b4446b361cc8601fde946cfa3e1/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b01647a0b2026d1c82a90d1803ade11e830be1b7482be84dd8a720092fce4be9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b01647a0b2026d1c82a90d1803ade11e830be1b7482be84dd8a720092fce4be9/userdata/shm major:0 minor:212 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b3a0ebba101cfd54e9bbbcc342150b52bc245084174577fa3dd30cb1196dc9eb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b3a0ebba101cfd54e9bbbcc342150b52bc245084174577fa3dd30cb1196dc9eb/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c635f584c6c881bc86ee65dcd08ac3ec7465ba5329b8a70dda08e535f197fd14/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c635f584c6c881bc86ee65dcd08ac3ec7465ba5329b8a70dda08e535f197fd14/userdata/shm major:0 minor:254 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d30ffdaecdbe7b9349b7cbf431f0263f1f83da99fdd4d8922a16f20e1ce2ca8b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d30ffdaecdbe7b9349b7cbf431f0263f1f83da99fdd4d8922a16f20e1ce2ca8b/userdata/shm major:0 minor:314 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ed20760fcc7c0a6da3c68bc93c5bb77352501f8ffe2695a9fdf332ab2f40e1ea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ed20760fcc7c0a6da3c68bc93c5bb77352501f8ffe2695a9fdf332ab2f40e1ea/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/effbc4003012eca7e1fb5d9168910f1f9ea43d1252511efbba6c76843e77e25c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/effbc4003012eca7e1fb5d9168910f1f9ea43d1252511efbba6c76843e77e25c/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03fbd825-e35c-44be-9057-71b672a3ce15/volumes/kubernetes.io~projected/kube-api-access-b4z49:{mountpoint:/var/lib/kubelet/pods/03fbd825-e35c-44be-9057-71b672a3ce15/volumes/kubernetes.io~projected/kube-api-access-b4z49 major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03fbd825-e35c-44be-9057-71b672a3ce15/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/03fbd825-e35c-44be-9057-71b672a3ce15/volumes/kubernetes.io~secret/metrics-certs major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ac79e70-8d1c-4673-aab0-8d8ad7d76880/volumes/kubernetes.io~projected/kube-api-access-qzf76:{mountpoint:/var/lib/kubelet/pods/1ac79e70-8d1c-4673-aab0-8d8ad7d76880/volumes/kubernetes.io~projected/kube-api-access-qzf76 major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ca80b40-dc5f-479b-b73c-4683cd09c83a/volumes/kubernetes.io~projected/kube-api-access-xlx2h:{mountpoint:/var/lib/kubelet/pods/2ca80b40-dc5f-479b-b73c-4683cd09c83a/volumes/kubernetes.io~projected/kube-api-access-xlx2h major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ca80b40-dc5f-479b-b73c-4683cd09c83a/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/2ca80b40-dc5f-479b-b73c-4683cd09c83a/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:267 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30e6a857-4975-4101-9e1f-a860bd3fd3af/volumes/kubernetes.io~projected/kube-api-access-ltsnx:{mountpoint:/var/lib/kubelet/pods/30e6a857-4975-4101-9e1f-a860bd3fd3af/volumes/kubernetes.io~projected/kube-api-access-ltsnx major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40a71ede-b75a-4381-8299-49e46083e654/volumes/kubernetes.io~projected/kube-api-access-tsdtl:{mountpoint:/var/lib/kubelet/pods/40a71ede-b75a-4381-8299-49e46083e654/volumes/kubernetes.io~projected/kube-api-access-tsdtl major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/459de48d-02fa-4213-9351-85502d870f39/volumes/kubernetes.io~projected/kube-api-access-tcq8d:{mountpoint:/var/lib/kubelet/pods/459de48d-02fa-4213-9351-85502d870f39/volumes/kubernetes.io~projected/kube-api-access-tcq8d major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~projected/kube-api-access-d5t6k:{mountpoint:/var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~projected/kube-api-access-d5t6k major:0 minor:277 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:276 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:275 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~projected/kube-api-access-zj69v:{mountpoint:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~projected/kube-api-access-zj69v major:0 minor:244 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:248 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:247 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:249 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:250 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:245 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/813ebd55-ce29-4fde-931b-bd632c1b3658/volumes/kubernetes.io~projected/kube-api-access-6r7n4:{mountpoint:/var/lib/kubelet/pods/813ebd55-ce29-4fde-931b-bd632c1b3658/volumes/kubernetes.io~projected/kube-api-access-6r7n4 major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/813ebd55-ce29-4fde-931b-bd632c1b3658/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/813ebd55-ce29-4fde-931b-bd632c1b3658/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~empty-dir/tmp major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~projected/kube-api-access-q9jmj:{mountpoint:/var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~projected/kube-api-access-q9jmj major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4/volumes/kubernetes.io~projected/kube-api-access-md2fm:{mountpoint:/var/lib/kubelet/pods/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4/volumes/kubernetes.io~projected/kube-api-access-md2fm major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/89d5aad3-0b99-49f0-802d-9312cfe33f8d/volumes/kubernetes.io~projected/kube-api-access-7x4v6:{mountpoint:/var/lib/kubelet/pods/89d5aad3-0b99-49f0-802d-9312cfe33f8d/volumes/kubernetes.io~projected/kube-api-access-7x4v6 major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/config-reloader/2 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/prometheus/15 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~empty-dir/config-out major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~projected/kube-api-access-t5lf5:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~projected/kube-api-access-t5lf5 major:0 minor:344 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~projected/tls-assets major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/config major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/web-config major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/939fc194-d0cf-4ee7-8db2-bcf14992affc/volumes/kubernetes.io~projected/kube-api-access-5wz64:{mountpoint:/var/lib/kubelet/pods/939fc194-d0cf-4ee7-8db2-bcf14992affc/volumes/kubernetes.io~projected/kube-api-access-5wz64 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/alertmanager/9 major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/config-reloader/6 major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~empty-dir/config-out major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~projected/kube-api-access-sfbdw:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~projected/kube-api-access-sfbdw major:0 minor:239 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~projected/tls-assets major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/config-volume major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/web-config major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~projected/kube-api-access-cnf4d:{mountpoint:/var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~projected/kube-api-access-cnf4d major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:200 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:112 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6386826-fe0a-4315-9714-4b107789df4f/volumes/kubernetes.io~projected/kube-api-access-stbsr:{mountpoint:/var/lib/kubelet/pods/c6386826-fe0a-4315-9714-4b107789df4f/volumes/kubernetes.io~projected/kube-api-access-stbsr major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c6386826-fe0a-4315-9714-4b107789df4f/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/c6386826-fe0a-4315-9714-4b107789df4f/volumes/kubernetes.io~secret/metrics-tls major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c8c13245-bedc-4277-8989-8c585941e3c0/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/c8c13245-bedc-4277-8989-8c585941e3c0/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb/volumes/kubernetes.io~projected/kube-api-access-fzhzh:{mountpoint:/var/lib/kubelet/pods/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb/volumes/kubernetes.io~projected/kube-api-access-fzhzh major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb/volumes/kubernetes.io~secret/cert major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volumes/kubernetes.io~projected/kube-api-access-dv9vv:{mountpoint:/var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volumes/kubernetes.io~projected/kube-api-access-dv9vv major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ecef226e-8496-4a01-9903-2ecd046af47e/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/ecef226e-8496-4a01-9903-2ecd046af47e/volumes/kubernetes.io~secret/agent-certs major:0 minor:47 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/6cb9528369c6efef733b482a354adefd9ea4c004ba330ae591d23365add79efb/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/b8611f6a18c786f7cc948c01ff0495c133f3e027c5d37ee73dd53d258006d1ac/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/dcb463cdda0c821fd7557db3676558946dc8081b9bb53677bf8d735e001ef2aa/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/affe7ded8c735c6a32b23977a1f0d64458674ebea8289cfd7d11b17341802ff8/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/c7d8b4dbaa6303eaff662dba00fdc9544390c553a3313526426cb636e00cf536/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-117:{mountpoint:/var/lib/containers/storage/overlay/e9a1c2b14df4fc46c1e7dc2d69dd14557139ed856c2e92e0e871ea0408174ab4/merged major:0 minor:117 fsType:overlay blockSize:0} overlay_0-122:{mountpoint:/var/lib/containers/storage/overlay/43183fddc051c529b1eb10ce92deae6772352de8a87e55873ffe8222dfacc551/merged major:0 minor:122 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/19fb0a96661c12343ad553c33e473670599b9a8b8430c50a36cea641ef7ada01/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/b968faa69c576f9f8118c79de85c1593c8f09a4d08db325bb901ba06fbf6a576/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/d58a641f57a996f107176bbd62a903dc4e28a6a9cda4f2d1dc392d19fc6e6858/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/3128fa13cc694e3d5215ec47c3798c5d77500b8cd253c0a3efbeb1b13085ec6e/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/1d0e6c54e73c9689a38801ca7b780999e52c988408e34b2c75e66673d185fddd/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/8beaa6ffe5b233eef93762dec9c22c93c76e7df4bc0334dc2818710e80a0d2f9/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-161:{mountpoint:/var/lib/containers/storage/overlay/c736c87f50490d4a71d21773b9f16b1472e8a76ecf4b46e5f3ec96a0b348a92f/merged major:0 minor:161 fsType:overlay blockSize:0} overlay_0-166:{mountpoint:/var/lib/containers/storage/overlay/5ac92546de674dcdf6d35e69eeeb2c3665ac3170af4e1c8242f8f3b1bf5171df/merged major:0 minor:166 fsType:overlay blockSize:0} overlay_0-171:{mountpoint:/var/lib/containers/storage/overlay/72195b52655a69c2e2200bc52ad4c910ed9128fc029b24dc33205196f5eb2da9/merged major:0 minor:171 fsType:overlay blockSize:0} overlay_0-176:{mountpoint:/var/lib/containers/storage/overlay/2f9d44f309f2cde8e1a6a4943285ec12edd7622361e48d1d87d1bee2095994c0/merged major:0 minor:176 fsType:overlay blockSize:0} overlay_0-181:{mountpoint:/var/lib/containers/storage/overlay/69bb5b99b293e18de85a097d42b342193046d14219b0d9862854b1986f2ad785/merged major:0 minor:181 fsType:overlay blockSize:0} overlay_0-186:{mountpoint:/var/lib/containers/storage/overlay/2c2df261bfe54cc9dfa30765d096375e5f9ec79a5b236d6a9b48ff7cb387bdad/merged major:0 minor:186 fsType:overlay blockSize:0} overlay_0-191:{mountpoint:/var/lib/containers/storage/overlay/bf386d11a2a3f0dc054bcf11d2316dc57cbe7f51bf959abdfc5791b50b8c71e2/merged major:0 minor:191 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/7cde542b33e839d51c16d853b8711023bd28f68a11a2e07f4118808e74bd78fb/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/a228ba0eccc9d557a661a7e1bfbeec29b24aa5eec3873ee84dc1666e6574dac5/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/f09da7be637a7d858d04ca7164f61baee9e31892b04d25408c95a91a5c4564d9/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/109de635ed9ecbeda35774824cf5945b758edb4faae493ab8c2ddd4cc4b587d5/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-224:{mountpoint:/var/lib/containers/storage/overlay/755451fd376f11d0d33edd2ed2910f3734f84a3acb26851217e32522e1aaf8b4/merged major:0 minor:224 fsType:overlay blockSize:0} overlay_0-242:{mountpoint:/var/lib/containers/storage/overlay/b3112ca1b4750844cf0ef6abc2e975f815b146f59a9c3ff94bbe6c68d5a0245e/merged major:0 minor:242 fsType:overlay blockSize:0} overlay_0-251:{mountpoint:/var/lib/containers/storage/overlay/46efedbad647d9e06b68145253dc8bd050132e801be15d2a832d87f4545b1bdb/merged major:0 minor:251 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/14623b0e3b87efe98391f06cc9fa0d9672834454f0d2c8cc6684d63f3e881923/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/d4bc92ffb733342d67dfa052f8acffaf25ed77f7820a439af0a228b8c29c9211/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/91d40c25b4dbc589ed6e73742823c8f36990292aa451433365ecf7e2019dace6/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/f7702b242e5e01ebea51bd8f183e6018a23e5551c25bc6165f4db61fa4768c04/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/4f778195b0ad22116cd7674a2adb22badbbbf1372d866faa5afcd2b3297ad55e/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/2ff89214d05153875b27509abacca9a32f11a14a03fa1aafa7859d9d950f7dac/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/6d33f955b8cebf551f7e26a1fe994703cae9538d994ddd72ffdf2e0ee7e5f767/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-291:{mountpoint:/var/lib/containers/storage/overlay/3839e647e6dc0b496f499d35a4e8a7cee8636425888c4b763f20345e13647b61/merged major:0 minor:291 fsType:overlay blockSize:0} overlay_0-297:{mountpoint:/var/lib/containers/storage/overlay/c1a3cd4bada99c8cfe2a2b524d7a999a16417d15fc042ea088d01eac59b607fd/merged major:0 minor:297 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/66b7e87302fb1971a99ec7347612b4f337b7e42496ec3eb82c7ff87b85a5d421/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/d87e4b2acde72a58d2f64b50ebf331edbb5d4b6e1ce7a04a59edc8a798e22443/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/ef9ab80015ed460ed2d99603e52cfc046fb99173abc0b8f74707039c1dd8c636/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/855dc35fcf172b5747885ede684f88e4614274e20b35d8c4195906ec9247dc53/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/ffe638e05991ceddc9f898184e838c466734ec664cd42d925b646773834703d2/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/b6a5c444cf8e65c5645d18e7066f4ce431cc2a45357725728961da3857a8a1d2/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/b223fabfbfaa6889fc00ef70ca245156d86b80f744b908848d32d597b680f80b/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/30552b438a2e2b3fa7a6729d97edbcc5e9d695058bf290a44419cfa2ebb8ec40/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/841f2b81b4ade6afaa9cbde731749cc205f9cf9d24331ffe78e45865d0ae26a5/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/769e073c029b0911ce0ac82675f174b0d6352132e065964fa277cdb8e4514288/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/112ce58b5b26bcda5494379ee47260894249e24b04cf7e9fb005927c02cacf07/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/df722cbfa699b1dbe9a9fd7c8f5dcfdde8d0ad45902e55d0b6fb87812b5b5821/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-378:{mountpoint:/var/lib/containers/storage/overlay/9cf053397763c3b042dd2dec83917614245a900b3148cbc2c3cb30abffa01e35/merged major:0 minor:378 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/8d427fdf26116ec50a151ce880815373799f9cddbd34d9b448e0b306fdd8e6fc/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-389:{mountpoint:/var/lib/containers/storage/overlay/f6784edbb33c40a9da5c9ce108c3cee8c45b21b2f27ee4201e8421c035694c04/merged major:0 minor:389 fsType:overlay blockSize:0} overlay_0-394:{mountpoint:/var/lib/containers/storage/overlay/f705e73e8e6f695df7763430d067b39a7e215fdc2d6218e545a6137b9b8fae63/merged major:0 minor:394 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/2b50dab2933fad6e38e4dc9363b5d05aae93f6b5889d476ead8dc934d11fc33c/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-402:{mountpoint:/var/lib/containers/storage/overlay/b911bf9c9a08ce18f7fdce363185325cdab003eac2df71ae22080b953fcbc2bf/merged major:0 minor:402 fsType:overlay blockSize:0} overlay_0-407:{mountpoint:/var/lib/containers/storage/overlay/17dd6ffc6a40de1032902b07eff5f0945079851d7a521ab58af4cc4848407ce6/merged major:0 minor:407 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/a1373e51a460eb8296af885f828975df7cb64162bac73bcd568897ecc0e43e1d/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/38a2a86cb1f8d212664919aca7bccec3eee640bf9fe08a0d69b5a523cf84c1d4/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-424:{mountpoint:/var/lib/containers/storage/overlay/a88d774e08d5079b4b7e0e0a2f6155719071fb6cc059421eaae5d512eeceae24/merged major:0 minor:424 fsType:overlay blockSize:0} overlay_0-430:{mountpoint:/var/lib/containers/storage/overlay/addbb2da10b22586f964393db7f93eacf2466d1fc1daa745c54b4c23ab9c36b7/merged major:0 minor:430 fsType:overlay blockSize:0} overlay_0-435:{mountpoint:/var/lib/containers/storage/overlay/fd28077daa00c6b0ca385b62c0c02216cdeff2fcce85d9ba26146c8e7e394d3e/merged major:0 minor:435 fsType:overlay blockSize:0} overlay_0-440:{mountpoint:/var/lib/containers/storage/overlay/a513a09105fc76db5da8a6c8c9adab8daf4d17e4c4d8ae3e34f1e00f619286b3/merged major:0 minor:440 fsType:overlay blockSize:0} overlay_0-445:{mountpoint:/var/lib/containers/storage/overlay/d800c55ee7fdd761e8c922dbec6c62f284f9d6a032cf40efa54e9f5f0238b1f5/merged major:0 minor:445 fsType:overlay blockSize:0} overlay_0-45:{mountpoint:/var/lib/containers/storage/overlay/8b9342ac7ba9002a6875616f64434025ca3d935ee69c528dff05af2dd9b6af68/merged major:0 minor:45 fsType:overlay blockSize:0} overlay_0-455:{mountpoint:/var/lib/containers/storage/overlay/c658cb20bab2a77a2fdb2baec6f3b0f6af7157ad98e50a95ef61e71c7cc8aee4/merged major:0 minor:455 fsType:overlay blockSize:0} overlay_0-62:{mountpoint:/var/lib/containers/storage/overlay/b6d843a9df8313f605d3d2e0ce1ce2ce47daa0bbc2cda44f58ef20e8d8800694/merged major:0 minor:62 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/292e3a19a1792f26cb9bdfa8590e502f7e084d5cba5a68669ad8f5ccd9422016/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/c158d62f83fd9787620289db6c7b54d6b80a425c2b9b7af5041519f6526f76b4/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/9fa12e86b8c3bcf0b278561a6b414031badf4e44bf8881b2214222574dda8f09/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/1dea3515af92d7746ba73b48b1f3953bbd24c0677c9f0d72995b12c6abfaff1c/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/88e1703aa0040b4cdbc7d4d02334c360931fb004b59245aaabb0cf636bae0413/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/7972f725d0fed99614db54cd2f51a477deb458f7c15a89c7f6a02ab6c556571d/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/637c1da0ec0bde3c6bb086e048e0e2e74e6a9221fd556de57dc319ebad4426f5/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/dbc02949c80ea4af6f4ee9e5e109060eb7138935c32ae25525b9add2b8da5fe8/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/69adce15853ce69c91a642a5030cf90be92006ae35f1c8067209c2fc77c1c403/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.304298    5529 manager.go:217] Machine: {Timestamp:2026-11-01 03:42:59.303798129 +0000 UTC m=+0.063525928 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100324 MemoryCapacity:33164328960 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec294a8634e83bc48b1bd46672c2b297 SystemUUID:ec294a86-34e8-3bc4-8b1b-d46672c2b297 BootID:ccceaaf2-ab22-4012-b178-3a943ab6a75e Filesystems:[{Device:overlay_0-62 DeviceMajor:0 DeviceMinor:62 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-166 DeviceMajor:0 DeviceMinor:166 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:233 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7737da0b70e5d7bf1f32cc6e5b64137159336fcefa002d95968f41b61b7dccf0/userdata/shm DeviceMajor:0 DeviceMinor:318 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:339 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ed20760fcc7c0a6da3c68bc93c5bb77352501f8ffe2695a9fdf332ab2f40e1ea/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:245 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-430 DeviceMajor:0 DeviceMinor:430 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:200 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:208 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:235 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c635f584c6c881bc86ee65dcd08ac3ec7465ba5329b8a70dda08e535f197fd14/userdata/shm DeviceMajor:0 DeviceMinor:254 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:48 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/89d5aad3-0b99-49f0-802d-9312cfe33f8d/volumes/kubernetes.io~projected/kube-api-access-7x4v6 DeviceMajor:0 DeviceMinor:55 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-389 DeviceMajor:0 DeviceMinor:389 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8759f3f175e1411f59cd84a0da382512473c30cb06797d190d905b7a9d96464c/userdata/shm DeviceMajor:0 DeviceMinor:64 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:338 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:333 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/03fbd825-e35c-44be-9057-71b672a3ce15/volumes/kubernetes.io~projected/kube-api-access-b4z49 DeviceMajor:0 DeviceMinor:53 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-251 DeviceMajor:0 DeviceMinor:251 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ecef226e-8496-4a01-9903-2ecd046af47e/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:47 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-171 DeviceMajor:0 DeviceMinor:171 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:238 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5b28f1b195f3027b6b65b5620221ad791d83675697ae9de2b192a5f23ad74ae5/userdata/shm DeviceMajor:0 DeviceMinor:272 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:333 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/459de48d-02fa-4213-9351-85502d870f39/volumes/kubernetes.io~projected/kube-api-access-tcq8d DeviceMajor:0 DeviceMinor:52 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:250 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:234 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volumes/kubernetes.io~projected/kube-api-access-dv9vv DeviceMajor:0 DeviceMinor:57 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c6386826-fe0a-4315-9714-4b107789df4f/volumes/kubernetes.io~projected/kube-api-access-stbsr DeviceMajor:0 DeviceMinor:209 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/14484256ddd47ccaeb05aefd3f347ae63c9a1408bba510952877feb587101e5e/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:276 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:332 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-378 DeviceMajor:0 DeviceMinor:378 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:328 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:49 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:50 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/72a2df738f15356962d08fa34212eaf3c363be5155284a0c90a39236c6458ca3/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~projected/kube-api-access-d5t6k DeviceMajor:0 DeviceMinor:277 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:234 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:333 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb/volumes/kubernetes.io~projected/kube-api-access-fzhzh DeviceMajor:0 DeviceMinor:211 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-224 DeviceMajor:0 DeviceMinor:224 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~projected/kube-api-access-sfbdw DeviceMajor:0 DeviceMinor:239 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-407 DeviceMajor:0 DeviceMinor:407 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-455 DeviceMajor:0 DeviceMinor:455 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582164480 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-186 DeviceMajor:0 DeviceMinor:186 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/82ece44ef0d9220debf93c153f976f180ad04300a0736e3ce47a7f250b58526a/userdata/shm DeviceMajor:0 DeviceMinor:320 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-402 DeviceMajor:0 DeviceMinor:402 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9d5afb45a99d26bb448a850d023b29dedd5ec2a0c019396fc455024da185e683/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-191 DeviceMajor:0 DeviceMinor:191 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~projected/kube-api-access-cnf4d DeviceMajor:0 DeviceMinor:201 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:237 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-176 DeviceMajor:0 DeviceMinor:176 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:275 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:333 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b3a0ebba101cfd54e9bbbcc342150b52bc245084174577fa3dd30cb1196dc9eb/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2ca80b40-dc5f-479b-b73c-4683cd09c83a/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:267 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-435 DeviceMajor:0 DeviceMinor:435 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a4f4a60812e4e244788d4618b856c8c749008b4446b361cc8601fde946cfa3e1/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-291 DeviceMajor:0 DeviceMinor:291 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:234 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/48d03f922714f86f3d77b99a4be17cf42282012c31d07d3a776d5216e83daae7/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:335 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:341 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/581db867311109d850de4595ae38ac1262e28c30e0780806dc78b40dab7f02d8/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:236 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:249 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:337 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-45 DeviceMajor:0 DeviceMinor:45 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9b725795-a5f2-4b23-9429-d0bb34b56251/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:112 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c6386826-fe0a-4315-9714-4b107789df4f/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:207 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:226 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:246 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/17fd215d69b57bcffb141ac4f73960ab862a0c79c18878f3a85b46821ae0e2ab/userdata/shm DeviceMajor:0 DeviceMinor:280 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/870f99e7-36f6-4e6e-b166-963313638a23/volumes/kubernetes.io~projected/kube-api-access-q9jmj DeviceMajor:0 DeviceMinor:56 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-117 DeviceMajor:0 DeviceMinor:117 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-161 DeviceMajor:0 DeviceMinor:161 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b01647a0b2026d1c82a90d1803ade11e830be1b7482be84dd8a720092fce4be9/userdata/shm DeviceMajor:0 DeviceMinor:212 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:247 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2ca80b40-dc5f-479b-b73c-4683cd09c83a/volumes/kubernetes.io~projected/kube-api-access-xlx2h DeviceMajor:0 DeviceMinor:271 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/813ebd55-ce29-4fde-931b-bd632c1b3658/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:206 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:234 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/03fbd825-e35c-44be-9057-71b672a3ce15/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:307 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:343 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-394 DeviceMajor:0 DeviceMinor:394 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/939fc194-d0cf-4ee7-8db2-bcf14992affc/volumes/kubernetes.io~projected/kube-api-access-5wz64 DeviceMajor:0 DeviceMinor:59 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/effbc4003012eca7e1fb5d9168910f1f9ea43d1252511efbba6c76843e77e25c/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:248 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/30e6a857-4975-4101-9e1f-a860bd3fd3af/volumes/kubernetes.io~projected/kube-api-access-ltsnx DeviceMajor:0 DeviceMinor:313 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d30ffdaecdbe7b9349b7cbf431f0263f1f83da99fdd4d8922a16f20e1ce2ca8b/userdata/shm DeviceMajor:0 DeviceMinor:314 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-122 DeviceMajor:0 DeviceMinor:122 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5f4fd259-d210-48c2-a14a-d29656a3aa34/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:274 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/13187460c8f733ab1ccdf12b209de8248188b69ca5dbfe5a045bd3eaac2bc87c/userdata/shm DeviceMajor:0 DeviceMinor:69 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a13f3a25b62a0b935fd16a306a7c1bcf96066e6c38ce3f8a66dce5e5613d6f0/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/527cc793cecb8fc1eb028e2e485cfd1883a8ae4f42093c371a7d9eaafe0f3a4f/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-181 DeviceMajor:0 DeviceMinor:181 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:340 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-445 DeviceMajor:0 DeviceMinor:445 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4e1f6c8c36cef36939a09ec56a214cf6f34172962b3d1cadd67ffc8216175b03/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-242 DeviceMajor:0 DeviceMinor:242 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-297 DeviceMajor:0 DeviceMinor:297 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-424 DeviceMajor:0 DeviceMinor:424 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1ac79e70-8d1c-4673-aab0-8d8ad7d76880/volumes/kubernetes.io~projected/kube-api-access-qzf76 DeviceMajor:0 DeviceMinor:54 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4/volumes/kubernetes.io~projected/kube-api-access-md2fm DeviceMajor:0 DeviceMinor:58 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ec9f5780-5d84-44be-bf3a-b3eb26d0808c/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:231 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c8c13245-bedc-4277-8989-8c585941e3c0/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:312 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:342 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632865792 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:232 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93da4576-fc49-4c08-8105-bcc0e81ea27a/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:233 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8bd0c5f5-a794-4d20-b439-262ad4704f8a/volumes/kubernetes.io~projected/kube-api-access-t5lf5 DeviceMajor:0 DeviceMinor:344 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/40a71ede-b75a-4381-8299-49e46083e654/volumes/kubernetes.io~projected/kube-api-access-tsdtl DeviceMajor:0 DeviceMinor:51 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1f5d02f86a5da390e55ca1375289ab46c8800a6cecc944eb3ff4477e8deb504a/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/813ebd55-ce29-4fde-931b-bd632c1b3658/volumes/kubernetes.io~projected/kube-api-access-6r7n4 DeviceMajor:0 DeviceMinor:210 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5f580cb7-edb1-4422-b86b-947fea4f1c5c/volumes/kubernetes.io~projected/kube-api-access-zj69v DeviceMajor:0 DeviceMinor:244 Capacity:31985729536 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-440 DeviceMajor:0 DeviceMinor:440 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:14484256ddd47cc MacAddress:aa:1f:1f:28:a5:32 Speed:10000 Mtu:8901} {Name:17fd215d69b57bc MacAddress:9a:70:1a:d6:a3:22 Speed:10000 Mtu:8901} {Name:48d03f922714f86 MacAddress:36:1e:e7:89:54:d0 Speed:10000 Mtu:8901} {Name:4e1f6c8c36cef36 MacAddress:1e:16:aa:21:d5:5b Speed:10000 Mtu:8901} {Name:581db867311109d MacAddress:72:d8:b8:27:c5:87 Speed:10000 Mtu:8901} {Name:5b28f1b195f3027 MacAddress:fe:c0:6b:a9:22:cc Speed:10000 Mtu:8901} {Name:7737da0b70e5d7b MacAddress:e6:6b:ac:3f:f8:e1 Speed:10000 Mtu:8901} {Name:82ece44ef0d9220 MacAddress:0a:dc:0a:f3:ab:78 Speed:10000 Mtu:8901} {Name:b01647a0b2026d1 MacAddress:e6:45:c4:24:0a:50 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:c5:e0:56:d5 Speed:0 Mtu:9001} {Name:br-int MacAddress:9e:ad:a3:ce:b5:52 Speed:0 Mtu:8901} {Name:c635f584c6c881b MacAddress:ca:08:9a:3c:72:b5 Speed:10000 Mtu:8901} {Name:d30ffdaecdbe7b9 MacAddress:6a:ba:f9:d1:06:ce Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:c5:e0:56:d5 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:fe:70:51:71:27:6f Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:d2:d3:e8:3b:ed:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164328960 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.304778    5529 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.304833    5529 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305133    5529 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305157    5529 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-214.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305305    5529 topology_manager.go:143] "Creating topology manager with none policy"
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305313    5529 container_manager_linux.go:311] "Creating device plugin manager"
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305326    5529 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305339    5529 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 01 03:42:59.305525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305423    5529 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 01 03:42:59.306050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305592    5529 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 01 03:42:59.306050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305723    5529 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 01 03:42:59.306050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305759    5529 kubelet.go:493] "Attempting to sync node with API server"
Nov 01 03:42:59.306050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305771    5529 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 01 03:42:59.306050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305788    5529 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 01 03:42:59.306050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305798    5529 kubelet.go:405] "Adding apiserver pod source"
Nov 01 03:42:59.306050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.305811    5529 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 01 03:42:59.308488 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.307317    5529 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 01 03:42:59.308488 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.307341    5529 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 01 03:42:59.308488 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.308018    5529 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 01 03:42:59.328313 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328249    5529 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 01 03:42:59.328313 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328267    5529 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 01 03:42:59.328453 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328389    5529 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 01 03:42:59.328621 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328609    5529 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 01 03:42:59.328652 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328640    5529 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 01 03:42:59.328762 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328752    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 01 03:42:59.328795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328767    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 01 03:42:59.328795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328776    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 01 03:42:59.328795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328782    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 01 03:42:59.328795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328787    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 01 03:42:59.328795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328793    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 01 03:42:59.328925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328799    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 01 03:42:59.328925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328808    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 01 03:42:59.328925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328818    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 01 03:42:59.328925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328833    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 01 03:42:59.328925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328846    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 01 03:42:59.328925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328855    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 01 03:42:59.328925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328880    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 01 03:42:59.328925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.328888    5529 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 01 03:42:59.332599 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.332582    5529 server.go:1263] "Started kubelet"
Nov 01 03:42:59.332724 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.332688    5529 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 01 03:42:59.332793 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.332685    5529 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 01 03:42:59.332793 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.332764    5529 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 01 03:42:59.333144 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.333113    5529 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 01 03:42:59.333131 ip-10-0-136-214 systemd[1]: Started Kubernetes Kubelet.
Nov 01 03:42:59.333997 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.333974    5529 server.go:317] "Adding debug handlers to kubelet server"
Nov 01 03:42:59.337203 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.337176    5529 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 01 03:42:59.337327 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.337200    5529 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 01 03:42:59.338567 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.337718    5529 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-214.us-west-2.compute.internal\" not found"
Nov 01 03:42:59.338567 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.337765    5529 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-31 03:36:47 +0000 UTC" deadline="2028-07-14 08:14:52.057863476 +0000 UTC"
Nov 01 03:42:59.338567 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.337828    5529 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14908h31m52.720040743s"
Nov 01 03:42:59.338567 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.337863    5529 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 01 03:42:59.338567 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.337879    5529 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 01 03:42:59.338567 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.338017    5529 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 01 03:42:59.341204 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.341156    5529 factory.go:153] Registering CRI-O factory
Nov 01 03:42:59.341204 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.341193    5529 factory.go:223] Registration of the crio container factory successfully
Nov 01 03:42:59.341382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.341260    5529 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 01 03:42:59.341382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.341271    5529 factory.go:55] Registering systemd factory
Nov 01 03:42:59.341382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.341281    5529 factory.go:223] Registration of the systemd container factory successfully
Nov 01 03:42:59.341382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.341300    5529 factory.go:103] Registering Raw factory
Nov 01 03:42:59.341382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.341314    5529 manager.go:1199] Started watching for new ooms in manager
Nov 01 03:42:59.342487 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.341715    5529 manager.go:319] Starting recovery of all containers
Nov 01 03:42:59.343702 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343645    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="89d5aad3-0b99-49f0-802d-9312cfe33f8d" volumeName="kubernetes.io/configmap/89d5aad3-0b99-49f0-802d-9312cfe33f8d-serviceca" seLinuxMountContext=""
Nov 01 03:42:59.343804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343701    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-metrics-client-ca" seLinuxMountContext=""
Nov 01 03:42:59.343804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343716    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config-out" seLinuxMountContext=""
Nov 01 03:42:59.343804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343728    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-kube-api-access-t5lf5" seLinuxMountContext=""
Nov 01 03:42:59.343804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343743    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec9f5780-5d84-44be-bf3a-b3eb26d0808c" volumeName="kubernetes.io/projected/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-kube-api-access-dv9vv" seLinuxMountContext=""
Nov 01 03:42:59.343804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343756    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ca80b40-dc5f-479b-b73c-4683cd09c83a" volumeName="kubernetes.io/secret/2ca80b40-dc5f-479b-b73c-4683cd09c83a-monitoring-plugin-cert" seLinuxMountContext=""
Nov 01 03:42:59.343804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343768    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/projected/5f580cb7-edb1-4422-b86b-947fea4f1c5c-kube-api-access-zj69v" seLinuxMountContext=""
Nov 01 03:42:59.343804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343783    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813ebd55-ce29-4fde-931b-bd632c1b3658" volumeName="kubernetes.io/secret/813ebd55-ce29-4fde-931b-bd632c1b3658-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 01 03:42:59.343804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343798    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343811    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343823    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-main-tls" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343835    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343849    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="459de48d-02fa-4213-9351-85502d870f39" volumeName="kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-binary-copy" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343860    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/configmap/5f580cb7-edb1-4422-b86b-947fea4f1c5c-metrics-client-ca" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343878    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-grpc-tls" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343904    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343915    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec9f5780-5d84-44be-bf3a-b3eb26d0808c" volumeName="kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-script-lib" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343927    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30e6a857-4975-4101-9e1f-a860bd3fd3af" volumeName="kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343939    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="459de48d-02fa-4213-9351-85502d870f39" volumeName="kubernetes.io/projected/459de48d-02fa-4213-9351-85502d870f39-kube-api-access-tcq8d" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343950    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f4fd259-d210-48c2-a14a-d29656a3aa34" volumeName="kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-client-ca-bundle" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343962    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f4fd259-d210-48c2-a14a-d29656a3aa34" volumeName="kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-client-certs" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343974    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-grpc-tls" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343987    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-out" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.343999    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6386826-fe0a-4315-9714-4b107789df4f" volumeName="kubernetes.io/empty-dir/c6386826-fe0a-4315-9714-4b107789df4f-tmp-dir" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344013    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec9f5780-5d84-44be-bf3a-b3eb26d0808c" volumeName="kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-config" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344025    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344039    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-db" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344052    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-kube-api-access-sfbdw" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344070    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-volume" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344082    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-thanos-prometheus-http-client-file" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344115    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03fbd825-e35c-44be-9057-71b672a3ce15" volumeName="kubernetes.io/projected/03fbd825-e35c-44be-9057-71b672a3ce15-kube-api-access-b4z49" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344145    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ca80b40-dc5f-479b-b73c-4683cd09c83a" volumeName="kubernetes.io/projected/2ca80b40-dc5f-479b-b73c-4683cd09c83a-kube-api-access-xlx2h" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344159    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 01 03:42:59.344187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344196    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813ebd55-ce29-4fde-931b-bd632c1b3658" volumeName="kubernetes.io/empty-dir/813ebd55-ce29-4fde-931b-bd632c1b3658-data-volume" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344207    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-tls-assets" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344220    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-tls" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344233    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-cluster-tls-config" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344244    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344257    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344268    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344280    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b725795-a5f2-4b23-9429-d0bb34b56251" volumeName="kubernetes.io/projected/9b725795-a5f2-4b23-9429-d0bb34b56251-kube-api-access-cnf4d" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344293    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b725795-a5f2-4b23-9429-d0bb34b56251" volumeName="kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-tls" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344305    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6386826-fe0a-4315-9714-4b107789df4f" volumeName="kubernetes.io/secret/c6386826-fe0a-4315-9714-4b107789df4f-metrics-tls" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344317    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1db98a7-0a5c-498d-9682-4ec8cf74ddfb" volumeName="kubernetes.io/projected/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-kube-api-access-fzhzh" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344328    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1db98a7-0a5c-498d-9682-4ec8cf74ddfb" volumeName="kubernetes.io/secret/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-cert" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344342    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f4fd259-d210-48c2-a14a-d29656a3aa34" volumeName="kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-metrics-server-audit-profiles" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344354    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="870f99e7-36f6-4e6e-b166-963313638a23" volumeName="kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-etc-tuned" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344367    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344379    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b725795-a5f2-4b23-9429-d0bb34b56251" volumeName="kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344390    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec9f5780-5d84-44be-bf3a-b3eb26d0808c" volumeName="kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-env-overrides" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344400    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ac79e70-8d1c-4673-aab0-8d8ad7d76880" volumeName="kubernetes.io/projected/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-kube-api-access-qzf76" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344410    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f4fd259-d210-48c2-a14a-d29656a3aa34" volumeName="kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344420    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344431    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-main-db" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344443    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-web-config" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344454    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec9f5780-5d84-44be-bf3a-b3eb26d0808c" volumeName="kubernetes.io/secret/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344476    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6386826-fe0a-4315-9714-4b107789df4f" volumeName="kubernetes.io/projected/c6386826-fe0a-4315-9714-4b107789df4f-kube-api-access-stbsr" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344490    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813ebd55-ce29-4fde-931b-bd632c1b3658" volumeName="kubernetes.io/configmap/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344503    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88e7df41-2eb8-4dce-8a4f-0170ea4d12e4" volumeName="kubernetes.io/projected/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-kube-api-access-md2fm" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344537    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-metrics-client-certs" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344554    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-tls-assets" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344566    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b725795-a5f2-4b23-9429-d0bb34b56251" volumeName="kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344580    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88e7df41-2eb8-4dce-8a4f-0170ea4d12e4" volumeName="kubernetes.io/configmap/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-iptables-alerter-script" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344593    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-metrics-client-ca" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344607    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f4fd259-d210-48c2-a14a-d29656a3aa34" volumeName="kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-tls" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344619    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="870f99e7-36f6-4e6e-b166-963313638a23" volumeName="kubernetes.io/projected/870f99e7-36f6-4e6e-b166-963313638a23-kube-api-access-q9jmj" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344633    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-kube-rbac-proxy" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344647    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b725795-a5f2-4b23-9429-d0bb34b56251" volumeName="kubernetes.io/empty-dir/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-textfile" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344659    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8c13245-bedc-4277-8989-8c585941e3c0" volumeName="kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344673    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ac79e70-8d1c-4673-aab0-8d8ad7d76880" volumeName="kubernetes.io/empty-dir/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-tmp-dir" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344686    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40a71ede-b75a-4381-8299-49e46083e654" volumeName="kubernetes.io/projected/40a71ede-b75a-4381-8299-49e46083e654-kube-api-access-tsdtl" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344701    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f4fd259-d210-48c2-a14a-d29656a3aa34" volumeName="kubernetes.io/empty-dir/5f4fd259-d210-48c2-a14a-d29656a3aa34-audit-log" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344714    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/empty-dir/5f580cb7-edb1-4422-b86b-947fea4f1c5c-tmp" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344726    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="89d5aad3-0b99-49f0-802d-9312cfe33f8d" volumeName="kubernetes.io/projected/89d5aad3-0b99-49f0-802d-9312cfe33f8d-kube-api-access-7x4v6" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344740    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="939fc194-d0cf-4ee7-8db2-bcf14992affc" volumeName="kubernetes.io/projected/939fc194-d0cf-4ee7-8db2-bcf14992affc-kube-api-access-5wz64" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344752    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93da4576-fc49-4c08-8105-bcc0e81ea27a" volumeName="kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344766    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c6386826-fe0a-4315-9714-4b107789df4f" volumeName="kubernetes.io/configmap/c6386826-fe0a-4315-9714-4b107789df4f-config-volume" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344780    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-web-config" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344795    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-tls" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344807    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03fbd825-e35c-44be-9057-71b672a3ce15" volumeName="kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344822    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40a71ede-b75a-4381-8299-49e46083e654" volumeName="kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-cni-binary-copy" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344838    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40a71ede-b75a-4381-8299-49e46083e654" volumeName="kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-multus-daemon-config" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344851    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="459de48d-02fa-4213-9351-85502d870f39" volumeName="kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344897    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344913    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b725795-a5f2-4b23-9429-d0bb34b56251" volumeName="kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-metrics-client-ca" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344927    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f4fd259-d210-48c2-a14a-d29656a3aa34" volumeName="kubernetes.io/projected/5f4fd259-d210-48c2-a14a-d29656a3aa34-kube-api-access-d5t6k" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344940    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813ebd55-ce29-4fde-931b-bd632c1b3658" volumeName="kubernetes.io/projected/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-api-access-6r7n4" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344954    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344969    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344982    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bd0c5f5-a794-4d20-b439-262ad4704f8a" volumeName="kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.344999    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecef226e-8496-4a01-9903-2ecd046af47e" volumeName="kubernetes.io/configmap/ecef226e-8496-4a01-9903-2ecd046af47e-konnectivity-ca" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.345014    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecef226e-8496-4a01-9903-2ecd046af47e" volumeName="kubernetes.io/secret/ecef226e-8496-4a01-9903-2ecd046af47e-agent-certs" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.345028    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="459de48d-02fa-4213-9351-85502d870f39" volumeName="kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.345041    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f580cb7-edb1-4422-b86b-947fea4f1c5c" volumeName="kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.345054    5529 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="870f99e7-36f6-4e6e-b166-963313638a23" volumeName="kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-tmp" seLinuxMountContext=""
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.345067    5529 reconstruct.go:97] "Volume reconstruction finished"
Nov 01 03:42:59.345356 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.345075    5529 reconciler.go:29] "Reconciler: start to sync state"
Nov 01 03:42:59.364067 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.364021    5529 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 01 03:42:59.365617 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.365592    5529 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 01 03:42:59.365617 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.365617    5529 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 01 03:42:59.365830 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.365636    5529 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 01 03:42:59.365830 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.365672    5529 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 01 03:42:59.369813 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.369779    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:42:59.370472 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.370441    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:42:59.387904 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.387874    5529 generic.go:356] "Generic (PLEG): container finished" podID="93da4576-fc49-4c08-8105-bcc0e81ea27a" containerID="cbb71954bc72a14bf699437a73f7132128862fe1494a4098b85cf13aaa227dc3" exitCode=0
Nov 01 03:42:59.390738 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.390714    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:42:59.390924 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.390741    5529 generic.go:356] "Generic (PLEG): container finished" podID="40a71ede-b75a-4381-8299-49e46083e654" containerID="c452daa8400f055ca8a92f526a16d85960ba57596e04c739483d02a8cb2a5375" exitCode=1
Nov 01 03:42:59.398201 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.398153    5529 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="9c47e9ace161cf2db63830f59bf816fcd7865b93a0ee743e6daa5a9346c61e13" exitCode=0
Nov 01 03:42:59.398201 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.398196    5529 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="57526ff33bb25dc0f35012fd69b9ed0c69f7738e75ad6c315fc57643c9d52db1" exitCode=0
Nov 01 03:42:59.398201 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.398205    5529 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="bfb011d1ff8f6a2e213ef668c384e9e204daa95b8ee532f3a28f0d9ebc5a949c" exitCode=0
Nov 01 03:42:59.398389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.398212    5529 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="c6f9759f644924953aae3c85b338d04c6cb16d32eef547c2407418577362ab02" exitCode=0
Nov 01 03:42:59.398389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.398217    5529 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="ed3374182b65e9e629fbfd3fe0d84b04b7c531342ab47d7e2d2e2d9499b3bcbb" exitCode=0
Nov 01 03:42:59.398389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.398223    5529 generic.go:356] "Generic (PLEG): container finished" podID="459de48d-02fa-4213-9351-85502d870f39" containerID="d6b401d9982d54fb27714edba3836c8f49daad4860dc095c67e48527a89081a8" exitCode=0
Nov 01 03:42:59.400081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.400060    5529 generic.go:356] "Generic (PLEG): container finished" podID="c462f6853597aa7799ac7948357b2573" containerID="4c8abe8cead383bf933e125c813f878698b62cbe0f12dfc1d527f79fd22dd999" exitCode=0
Nov 01 03:42:59.417393 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.417360    5529 generic.go:356] "Generic (PLEG): container finished" podID="8bd0c5f5-a794-4d20-b439-262ad4704f8a" containerID="2eaf94d305b95c2500c68745a573190d9f682127621ee71cb82269cf69c85a3c" exitCode=0
Nov 01 03:42:59.435999 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.435961    5529 generic.go:356] "Generic (PLEG): container finished" podID="9b725795-a5f2-4b23-9429-d0bb34b56251" containerID="9b858463c5c5d326ebd11b8a6b3a70826f6510bb1baaca06a6b9eec2c45a7908" exitCode=0
Nov 01 03:42:59.437819 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.437793    5529 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-136-214.us-west-2.compute.internal\" not found"
Nov 01 03:42:59.455800 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.455776    5529 manager.go:324] Recovery completed
Nov 01 03:42:59.465758 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.465726    5529 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 01 03:42:59.478653 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.478631    5529 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:42:59.481007 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.480988    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:42:59.481113 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.481022    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:42:59.481113 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.481035    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:42:59.483564 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483545    5529 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:42:59.483674 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483549    5529 cpu_manager.go:226] "Starting" policy="none"
Nov 01 03:42:59.483674 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483611    5529 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 01 03:42:59.483674 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483631    5529 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 01 03:42:59.483795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483769    5529 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 01 03:42:59.483795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483781    5529 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 01 03:42:59.483850 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483798    5529 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 01 03:42:59.483850 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483803    5529 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 01 03:42:59.483850 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483809    5529 policy_none.go:50] "Start"
Nov 01 03:42:59.483850 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483819    5529 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 01 03:42:59.483850 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483828    5529 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 01 03:42:59.483990 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483979    5529 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 01 03:42:59.483990 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483986    5529 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 01 03:42:59.484043 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.483991    5529 policy_none.go:44] "Start"
Nov 01 03:42:59.484595 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.484576    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:42:59.484652 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.484614    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:42:59.484652 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.484629    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:42:59.488943 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.488915    5529 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 01 03:42:59.491720 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.491706    5529 manager.go:341] "Starting Device Plugin manager"
Nov 01 03:42:59.491813 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.491731    5529 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 01 03:42:59.491813 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.491740    5529 server.go:87] "Starting device plugin registration server"
Nov 01 03:42:59.492073 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.492060    5529 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 01 03:42:59.492109 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.492076    5529 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 01 03:42:59.492182 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.492153    5529 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 01 03:42:59.492308 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.492267    5529 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 01 03:42:59.492308 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.492314    5529 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 01 03:42:59.492308 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.492321    5529 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 01 03:42:59.493538 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.492396    5529 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-01T03:42:59.492303557Z","UUID":"b0c8371c-476c-4a93-a485-0ded9b6122b8","Handler":null,"Name":"","Endpoint":""}
Nov 01 03:42:59.494678 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.494661    5529 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 01 03:42:59.494778 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.494685    5529 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 01 03:42:59.495480 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.495458    5529 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 01 03:42:59.495593 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.495516    5529 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-214.us-west-2.compute.internal\" not found"
Nov 01 03:42:59.525025 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.524999    5529 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:42:59.525025 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.525016    5529 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:42:59.525247 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.525215    5529 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 01 03:42:59.575704 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.575676    5529 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:42:59.592473 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.592399    5529 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 01 03:42:59.593700 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.593680    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 01 03:42:59.593811 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.593713    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 01 03:42:59.593811 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.593729    5529 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-136-214.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 01 03:42:59.593811 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.593774    5529 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.624877 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.624852    5529 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 01 03:42:59.666618 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.666567    5529 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"]
Nov 01 03:42:59.667247 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.667213    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"c462f6853597aa7799ac7948357b2573","Type":"ContainerStarted","Data":"4a173ef637de9dc4636bcc5ceb33ca6ee11e25ed02edb73815064efec949bcc7"}
Nov 01 03:42:59.667309 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.667255    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"c462f6853597aa7799ac7948357b2573","Type":"ContainerDied","Data":"4c8abe8cead383bf933e125c813f878698b62cbe0f12dfc1d527f79fd22dd999"}
Nov 01 03:42:59.667309 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.667257    5529 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.667422 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.667357    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"c462f6853597aa7799ac7948357b2573","Type":"ContainerStarted","Data":"8759f3f175e1411f59cd84a0da382512473c30cb06797d190d905b7a9d96464c"}
Nov 01 03:42:59.667422 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.667419    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"67398c77b717adfae75e6234ca803488","Type":"ContainerStarted","Data":"8951a9720445a10df5c86cc32232562b425fba580ec629271a677bd84958ddf5"}
Nov 01 03:42:59.667526 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.667434    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal" event={"ID":"67398c77b717adfae75e6234ca803488","Type":"ContainerStarted","Data":"effbc4003012eca7e1fb5d9168910f1f9ea43d1252511efbba6c76843e77e25c"}
Nov 01 03:42:59.667526 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.667502    5529 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.709374 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.709348    5529 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.709503 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.709418    5529 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.732934 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.732905    5529 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 01 03:42:59.733079 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.732957    5529 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.733458 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.733430    5529 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 01 03:42:59.733579 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:42:59.733469    5529 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.827874 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.827834    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.828051 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.827888    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.828051 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.827910    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67398c77b717adfae75e6234ca803488-config\") pod \"kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"67398c77b717adfae75e6234ca803488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.929001 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.928966    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.929001 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.929001    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.929223 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.929019    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67398c77b717adfae75e6234ca803488-config\") pod \"kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"67398c77b717adfae75e6234ca803488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.929223 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.929062    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67398c77b717adfae75e6234ca803488-config\") pod \"kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"67398c77b717adfae75e6234ca803488\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.929223 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.929091    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:42:59.929223 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:42:59.929089    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c462f6853597aa7799ac7948357b2573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" (UID: \"c462f6853597aa7799ac7948357b2573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:43:00.306685 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.306602    5529 apiserver.go:52] "Watching apiserver"
Nov 01 03:43:00.439571 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.439543    5529 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:43:00.439806 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.439716    5529 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:43:00.466284 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.466250    5529 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 01 03:43:00.466923 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.466889    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-m67pw","openshift-monitoring/prometheus-k8s-0","openshift-cluster-node-tuning-operator/tuned-9xmvl","openshift-monitoring/alertmanager-main-0","openshift-multus/multus-nb2ld","openshift-network-diagnostics/network-check-target-wztb4","openshift-image-registry/node-ca-f2vfp","openshift-network-operator/iptables-alerter-bjkt7","openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj","openshift-dns/node-resolver-zthp4","openshift-insights/insights-runtime-extractor-bdn62","openshift-monitoring/node-exporter-rjnsj","openshift-monitoring/thanos-querier-74f4d9d979-knqfv","openshift-multus/network-metrics-daemon-gcqhv","openshift-monitoring/metrics-server-86b5876bbc-85f92","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k","openshift-dns/dns-default-blgfn","openshift-ingress-canary/ingress-canary-vvb6t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal","kube-system/konnectivity-agent-gmh92","kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal","openshift-multus/multus-additional-cni-plugins-8dvks","openshift-ovn-kubernetes/ovnkube-node-cx9p7"]
Nov 01 03:43:00.505202 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.505156    5529 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 01 03:43:00.505346 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:43:00.505224    5529 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:43:00.509659 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.509638    5529 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 01 03:43:00.509770 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:43:00.509685    5529 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-214.us-west-2.compute.internal"
Nov 01 03:43:00.522920 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.522898    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 01 03:43:00.523069 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.523051    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 01 03:43:00.523130 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.523102    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 01 03:43:00.523216 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.523202    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-prgzf\""
Nov 01 03:43:00.523291 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.523229    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.523291 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.523239    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.523291 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.523238    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.523291 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.523260    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h4w6m\""
Nov 01 03:43:00.523291 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.523269    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dc6ls\""
Nov 01 03:43:00.525520 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.525500    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 01 03:43:00.525616 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.525604    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.525653 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.525618    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jjmfj\""
Nov 01 03:43:00.525653 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.525647    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 01 03:43:00.525707 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.525646    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tmt47\""
Nov 01 03:43:00.526724 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.526709    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 01 03:43:00.526907 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.526893    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.528081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528065    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zn4h5\""
Nov 01 03:43:00.528184 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528132    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.528233 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528190    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 01 03:43:00.528349 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528334    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.528408 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528355    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.528441 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528423    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qv2jj\""
Nov 01 03:43:00.528573 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528556    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.528655 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528626    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.528655 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528628    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.528655 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528635    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 01 03:43:00.528768 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528663    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.528768 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528677    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-v5dfc\""
Nov 01 03:43:00.528768 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528692    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 01 03:43:00.528768 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528708    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 01 03:43:00.528768 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528716    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.528954 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.528941    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.529059 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.529043    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-jzxr2\""
Nov 01 03:43:00.529120 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.529065    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 01 03:43:00.529120 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.529099    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 01 03:43:00.529120 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.529102    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 01 03:43:00.529273 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.529201    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-v2zmn\""
Nov 01 03:43:00.532116 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.532096    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.532217 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.532132    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 01 03:43:00.532217 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.532156    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.532334 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.532321    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-69w79\""
Nov 01 03:43:00.532376 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.532321    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7tm86\""
Nov 01 03:43:00.532376 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.532362    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 01 03:43:00.540698 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.540683    5529 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 01 03:43:00.555442 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.555418    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 01 03:43:00.555442 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.555433    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 01 03:43:00.555556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.555422    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 01 03:43:00.571892 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.571834    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 01 03:43:00.572005 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.571900    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ztkjl\""
Nov 01 03:43:00.572005 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.571905    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.572005 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.571994    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 01 03:43:00.572117 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.572007    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 01 03:43:00.572117 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.572010    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 01 03:43:00.575880 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.575866    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 01 03:43:00.577509 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.577496    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 01 03:43:00.577773 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.577758    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 01 03:43:00.577828 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.577803    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 01 03:43:00.577873 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.577804    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 01 03:43:00.578071 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578051    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 01 03:43:00.578142 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578073    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 01 03:43:00.578142 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578092    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 01 03:43:00.578142 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578120    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 01 03:43:00.578360 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578339    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 01 03:43:00.578410 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578347    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 01 03:43:00.578548 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578533    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8bv72\""
Nov 01 03:43:00.578604 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578590    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jx8x8\""
Nov 01 03:43:00.578660 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578609    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 01 03:43:00.578660 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.578632    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s4zsm\""
Nov 01 03:43:00.579563 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.579550    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 01 03:43:00.579979 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.579966    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 01 03:43:00.582492 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.582475    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 01 03:43:00.582492 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.582482    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 01 03:43:00.582644 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.582509    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.582644 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.582528    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 01 03:43:00.582644 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.582561    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 01 03:43:00.582644 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.582562    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.583386 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583363    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 01 03:43:00.583583 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583564    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-2mnqj\""
Nov 01 03:43:00.583697 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583683    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 01 03:43:00.583772 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583566    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 01 03:43:00.583820 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583769    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 01 03:43:00.583820 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583782    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 01 03:43:00.583944 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583822    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 01 03:43:00.583944 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583853    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tcptc\""
Nov 01 03:43:00.583944 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583911    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8fn5p\""
Nov 01 03:43:00.584080 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.583949    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 01 03:43:00.584080 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.584032    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 01 03:43:00.584195 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.584099    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cqurchiak8i88\""
Nov 01 03:43:00.584245 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.584207    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 01 03:43:00.584479 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.584461    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 01 03:43:00.584549 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.584479    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sbjbx\""
Nov 01 03:43:00.598392 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.598370    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b4lcx\""
Nov 01 03:43:00.598857 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.598843    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 01 03:43:00.598903 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.598870    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 01 03:43:00.598938 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.598919    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 01 03:43:00.598987 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.598973    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5q8kam09auued\""
Nov 01 03:43:00.602643 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.602626    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 01 03:43:00.602719 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.602643    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.602719 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.602643    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 01 03:43:00.602719 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.602657    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8onkr4n7reobd\""
Nov 01 03:43:00.602719 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.602677    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Nov 01 03:43:00.623989 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.623964    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 01 03:43:00.623989 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.623979    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 01 03:43:00.624125 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.624090    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 01 03:43:00.632385 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632362    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-kubernetes\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.632487 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632391    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-conf\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.632487 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632416    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-run\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.632487 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632447    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:43:00.632581 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632492    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6386826-fe0a-4315-9714-4b107789df4f-config-volume\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:00.632581 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632553    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/813ebd55-ce29-4fde-931b-bd632c1b3658-crio-socket\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.632667 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632595    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-tmp-dir\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:43:00.632667 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632641    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.632667 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632660    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-tmp-dir\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:43:00.632795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632690    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6386826-fe0a-4315-9714-4b107789df4f-config-volume\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:00.632795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632720    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.632795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632787    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-socket-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.632940 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632807    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8c13245-bedc-4277-8989-8c585941e3c0-original-pull-secret\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:43:00.632940 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632868    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbsr\" (UniqueName: \"kubernetes.io/projected/c6386826-fe0a-4315-9714-4b107789df4f-kube-api-access-stbsr\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:00.632940 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632878    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.632940 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632907    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.632940 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632929    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f580cb7-edb1-4422-b86b-947fea4f1c5c-tmp\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632946    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632963    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632969    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-bin\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.632994    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f580cb7-edb1-4422-b86b-947fea4f1c5c-tmp\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633008    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-accelerators-collector-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633037    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633068    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633095    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-var-lib-kubelet\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633115    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.633189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633128    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633231    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633253    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-accelerators-collector-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633301    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfbdw\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-kube-api-access-sfbdw\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633328    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-etc-selinux\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633353    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-tls\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633414    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633422    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-hostroot\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633463    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633534    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsdtl\" (UniqueName: \"kubernetes.io/projected/40a71ede-b75a-4381-8299-49e46083e654-kube-api-access-tsdtl\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633547    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-tls\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633571    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-tls\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.633594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633587    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633609    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633627    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-ovn\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633642    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-root\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633679    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633772    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-tls\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633796    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633819    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633865    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633879    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-multus-certs\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633898    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.633971    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.634013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634010    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-systemd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634041    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-env-overrides\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634014    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634186    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634194    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634231    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-device-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634246    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-env-overrides\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634256    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-systemd\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634281    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md2fm\" (UniqueName: \"kubernetes.io/projected/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-kube-api-access-md2fm\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634322    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634381    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634427    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-registration-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634463    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-iptables-alerter-script\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634542    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-log-socket\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.634556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634544    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634584    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-netd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634617    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-config\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634683    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-iptables-alerter-script\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634709    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634738    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-modprobe-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634779    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-multus-daemon-config\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634804    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4v6\" (UniqueName: \"kubernetes.io/projected/89d5aad3-0b99-49f0-802d-9312cfe33f8d-kube-api-access-7x4v6\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634809    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-config\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634830    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634871    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634891    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-metrics-client-ca\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.634906    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635013    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnf4d\" (UniqueName: \"kubernetes.io/projected/9b725795-a5f2-4b23-9429-d0bb34b56251-kube-api-access-cnf4d\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635042    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-kubelet\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635050    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635068    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f4fd259-d210-48c2-a14a-d29656a3aa34-audit-log\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635068    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-multus-daemon-config\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635095    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b725795-a5f2-4b23-9429-d0bb34b56251-metrics-client-ca\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.635177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635106    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-cert\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635287    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlx2h\" (UniqueName: \"kubernetes.io/projected/2ca80b40-dc5f-479b-b73c-4683cd09c83a-kube-api-access-xlx2h\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635293    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635298    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f4fd259-d210-48c2-a14a-d29656a3aa34-audit-log\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635341    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635442    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635469    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635472    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-cert\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635487    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wz64\" (UniqueName: \"kubernetes.io/projected/939fc194-d0cf-4ee7-8db2-bcf14992affc-kube-api-access-5wz64\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635581    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-sys\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635629    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/813ebd55-ce29-4fde-931b-bd632c1b3658-data-volume\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635669    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635686    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03fbd825-e35c-44be-9057-71b672a3ce15-metrics-certs\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635704    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635730    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635740    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635742    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/813ebd55-ce29-4fde-931b-bd632c1b3658-data-volume\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635750    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-conf-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635789    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-dbus\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635818    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6386826-fe0a-4315-9714-4b107789df4f-tmp-dir\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635848    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ecef226e-8496-4a01-9903-2ecd046af47e-agent-certs\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635861    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635874    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r7n4\" (UniqueName: \"kubernetes.io/projected/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-api-access-6r7n4\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635898    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635929    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89d5aad3-0b99-49f0-802d-9312cfe33f8d-serviceca\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.635958    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636016    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636058    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6386826-fe0a-4315-9714-4b107789df4f-tmp-dir\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636092    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5lf5\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-kube-api-access-t5lf5\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636116    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv9vv\" (UniqueName: \"kubernetes.io/projected/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-kube-api-access-dv9vv\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.636114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636140    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-client-certs\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636188    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ecef226e-8496-4a01-9903-2ecd046af47e-agent-certs\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636200    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636349    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636355    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636491    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-secret-metrics-server-client-certs\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636495    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89d5aad3-0b99-49f0-802d-9312cfe33f8d-serviceca\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636546    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-cnibin\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636567    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-client-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636595    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcq8d\" (UniqueName: \"kubernetes.io/projected/459de48d-02fa-4213-9351-85502d870f39-kube-api-access-tcq8d\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636620    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5t6k\" (UniqueName: \"kubernetes.io/projected/5f4fd259-d210-48c2-a14a-d29656a3aa34-kube-api-access-d5t6k\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636636    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636658    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636686    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzhzh\" (UniqueName: \"kubernetes.io/projected/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-kube-api-access-fzhzh\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636712    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj69v\" (UniqueName: \"kubernetes.io/projected/5f580cb7-edb1-4422-b86b-947fea4f1c5c-kube-api-access-zj69v\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636735    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636762    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-var-lib-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636787    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-bin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636811    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-netns\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636835    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-etc-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636828    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4fd259-d210-48c2-a14a-d29656a3aa34-client-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636862    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-textfile\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636899    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-netns\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636919    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ecef226e-8496-4a01-9903-2ecd046af47e-konnectivity-ca\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636936    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636946    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-textfile\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636956    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4z49\" (UniqueName: \"kubernetes.io/projected/03fbd825-e35c-44be-9057-71b672a3ce15-kube-api-access-b4z49\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.636973    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-sys-fs\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637015    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-system-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637069    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-grpc-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637094    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637121    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-systemd-units\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637147    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-volume\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.637173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637152    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ecef226e-8496-4a01-9903-2ecd046af47e-konnectivity-ca\") pod \"konnectivity-agent-gmh92\" (UID: \"ecef226e-8496-4a01-9903-2ecd046af47e\") " pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637198    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-lib-modules\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637203    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637345    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637389    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-metrics-server-audit-profiles\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637459    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-host\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637491    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/813ebd55-ce29-4fde-931b-bd632c1b3658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637516    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f580cb7-edb1-4422-b86b-947fea4f1c5c-metrics-client-ca\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637559    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637560    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637651    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-wtmp\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637690    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-k8s-cni-cncf-io\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637736    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637748    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637763    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637792    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-system-cni-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637844    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-metrics-server-audit-profiles\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637937    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f580cb7-edb1-4422-b86b-947fea4f1c5c-metrics-client-ca\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.637989    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638003    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638021    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/813ebd55-ce29-4fde-931b-bd632c1b3658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638034    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-socket-dir-parent\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638236    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638256    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638241    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-volume\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638295    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638300    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-slash\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.638413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638410    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-out\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638429    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jmj\" (UniqueName: \"kubernetes.io/projected/870f99e7-36f6-4e6e-b166-963313638a23-kube-api-access-q9jmj\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638428    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638468    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5f580cb7-edb1-4422-b86b-947fea4f1c5c-secret-grpc-tls\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638477    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638491    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-config-out\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638507    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638508    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638556    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-kubelet\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638630    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-etc-kubernetes\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638660    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638669    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ca80b40-dc5f-479b-b73c-4683cd09c83a-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638664    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4fd259-d210-48c2-a14a-d29656a3aa34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638697    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d5aad3-0b99-49f0-802d-9312cfe33f8d-host\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638735    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-hosts-file\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638785    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzf76\" (UniqueName: \"kubernetes.io/projected/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-kube-api-access-qzf76\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638906    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-web-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638916    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2ca80b40-dc5f-479b-b73c-4683cd09c83a-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638916    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.638940    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639002    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-sys\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639088    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-tmp\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639106    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/459de48d-02fa-4213-9351-85502d870f39-cni-binary-copy\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639109    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/93da4576-fc49-4c08-8105-bcc0e81ea27a-web-config\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639123    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639151    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-tmp\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639192    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-node-log\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639221    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovn-node-metrics-cert\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639223    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639237    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639269    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-cnibin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639305    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-cni-binary-copy\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639332    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-multus\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639359    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-kubelet-config\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639384    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.639389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639394    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovn-node-metrics-cert\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639433    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639461    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-script-lib\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639471    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40a71ede-b75a-4381-8299-49e46083e654-cni-binary-copy\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639510    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639557    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysconfig\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639569    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bd0c5f5-a794-4d20-b439-262ad4704f8a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639741    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-ovnkube-script-lib\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639841    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639858    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639875    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6386826-fe0a-4315-9714-4b107789df4f-metrics-tls\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639889    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-etc-tuned\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639906    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-host-slash\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639940    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639924    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.639980    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/870f99e7-36f6-4e6e-b166-963313638a23-etc-tuned\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.640050    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bd0c5f5-a794-4d20-b439-262ad4704f8a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.640054    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.640072    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/93da4576-fc49-4c08-8105-bcc0e81ea27a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.640497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.640255    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6386826-fe0a-4315-9714-4b107789df4f-metrics-tls\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:00.695111 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.695079    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbsr\" (UniqueName: \"kubernetes.io/projected/c6386826-fe0a-4315-9714-4b107789df4f-kube-api-access-stbsr\") pod \"dns-default-blgfn\" (UID: \"c6386826-fe0a-4315-9714-4b107789df4f\") " pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:00.695255 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.695212    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md2fm\" (UniqueName: \"kubernetes.io/projected/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-kube-api-access-md2fm\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:43:00.695293 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.695258    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfbdw\" (UniqueName: \"kubernetes.io/projected/93da4576-fc49-4c08-8105-bcc0e81ea27a-kube-api-access-sfbdw\") pod \"alertmanager-main-0\" (UID: \"93da4576-fc49-4c08-8105-bcc0e81ea27a\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 01 03:43:00.696840 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.696817    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsdtl\" (UniqueName: \"kubernetes.io/projected/40a71ede-b75a-4381-8299-49e46083e654-kube-api-access-tsdtl\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.700523 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.700506    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnf4d\" (UniqueName: \"kubernetes.io/projected/9b725795-a5f2-4b23-9429-d0bb34b56251-kube-api-access-cnf4d\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.701991 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.701970    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlx2h\" (UniqueName: \"kubernetes.io/projected/2ca80b40-dc5f-479b-b73c-4683cd09c83a-kube-api-access-xlx2h\") pod \"monitoring-plugin-77f4f76594-6c6fj\" (UID: \"2ca80b40-dc5f-479b-b73c-4683cd09c83a\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:43:00.707291 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.707270    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r7n4\" (UniqueName: \"kubernetes.io/projected/813ebd55-ce29-4fde-931b-bd632c1b3658-kube-api-access-6r7n4\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.707940 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.707921    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5t6k\" (UniqueName: \"kubernetes.io/projected/5f4fd259-d210-48c2-a14a-d29656a3aa34-kube-api-access-d5t6k\") pod \"metrics-server-86b5876bbc-85f92\" (UID: \"5f4fd259-d210-48c2-a14a-d29656a3aa34\") " pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:00.708458 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.708438    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4v6\" (UniqueName: \"kubernetes.io/projected/89d5aad3-0b99-49f0-802d-9312cfe33f8d-kube-api-access-7x4v6\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:43:00.708571 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.708549    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4z49\" (UniqueName: \"kubernetes.io/projected/03fbd825-e35c-44be-9057-71b672a3ce15-kube-api-access-b4z49\") pod \"network-metrics-daemon-gcqhv\" (UID: \"03fbd825-e35c-44be-9057-71b672a3ce15\") " pod="openshift-multus/network-metrics-daemon-gcqhv"
Nov 01 03:43:00.708617 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.708584    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcq8d\" (UniqueName: \"kubernetes.io/projected/459de48d-02fa-4213-9351-85502d870f39-kube-api-access-tcq8d\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.708673 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.708654    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5lf5\" (UniqueName: \"kubernetes.io/projected/8bd0c5f5-a794-4d20-b439-262ad4704f8a-kube-api-access-t5lf5\") pod \"prometheus-k8s-0\" (UID: \"8bd0c5f5-a794-4d20-b439-262ad4704f8a\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:00.708796 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.708777    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jmj\" (UniqueName: \"kubernetes.io/projected/870f99e7-36f6-4e6e-b166-963313638a23-kube-api-access-q9jmj\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.708841 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.708827    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj69v\" (UniqueName: \"kubernetes.io/projected/5f580cb7-edb1-4422-b86b-947fea4f1c5c-kube-api-access-zj69v\") pod \"thanos-querier-74f4d9d979-knqfv\" (UID: \"5f580cb7-edb1-4422-b86b-947fea4f1c5c\") " pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:00.712904 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.712885    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzhzh\" (UniqueName: \"kubernetes.io/projected/e1db98a7-0a5c-498d-9682-4ec8cf74ddfb-kube-api-access-fzhzh\") pod \"ingress-canary-vvb6t\" (UID: \"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb\") " pod="openshift-ingress-canary/ingress-canary-vvb6t"
Nov 01 03:43:00.713423 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.713407    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv9vv\" (UniqueName: \"kubernetes.io/projected/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-kube-api-access-dv9vv\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.713471 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.713414    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wz64\" (UniqueName: \"kubernetes.io/projected/939fc194-d0cf-4ee7-8db2-bcf14992affc-kube-api-access-5wz64\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.715465 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.715444    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzf76\" (UniqueName: \"kubernetes.io/projected/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-kube-api-access-qzf76\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:43:00.715724 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.715711    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltsnx\" (UniqueName: \"kubernetes.io/projected/30e6a857-4975-4101-9e1f-a860bd3fd3af-kube-api-access-ltsnx\") pod \"network-check-target-wztb4\" (UID: \"30e6a857-4975-4101-9e1f-a860bd3fd3af\") " pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:43:00.740742 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740718    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.740849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740752    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-sys\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.740849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740776    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-conf-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.740849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740821    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.740849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740828    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-sys\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.740976 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740826    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-conf-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.740976 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740879    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-dbus\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:43:00.740976 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740911    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-cnibin\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.740976 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740959    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-cnibin\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740976    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-var-lib-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740995    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-bin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741016    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-netns\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741031    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-etc-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.740978    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-dbus\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741045    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-netns\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741069    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-sys-fs\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741076    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-var-lib-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741076    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-bin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741071    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-run-netns\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741094    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-system-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741111    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-etc-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741125    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-netns\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741144    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-system-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741113    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-sys-fs\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741154    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-systemd-units\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741129    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-systemd-units\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741202    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-lib-modules\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741216    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741230    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-host\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741247    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-wtmp\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.741258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741268    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-k8s-cni-cncf-io\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741292    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-system-cni-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741303    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-cni-dir\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741311    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-host\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741315    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-socket-dir-parent\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741330    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-k8s-cni-cncf-io\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741347    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-slash\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741352    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-system-cni-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741362    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-multus-socket-dir-parent\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741372    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-kubelet\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741380    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-node-exporter-wtmp\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741395    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-lib-modules\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741402    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-kubelet\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741396    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-etc-kubernetes\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741400    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-slash\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741432    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-etc-kubernetes\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741436    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d5aad3-0b99-49f0-802d-9312cfe33f8d-host\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741461    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-hosts-file\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741500    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89d5aad3-0b99-49f0-802d-9312cfe33f8d-host\") pod \"node-ca-f2vfp\" (UID: \"89d5aad3-0b99-49f0-802d-9312cfe33f8d\") " pod="openshift-image-registry/node-ca-f2vfp"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741507    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ac79e70-8d1c-4673-aab0-8d8ad7d76880-hosts-file\") pod \"node-resolver-zthp4\" (UID: \"1ac79e70-8d1c-4673-aab0-8d8ad7d76880\") " pod="openshift-dns/node-resolver-zthp4"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741522    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-sys\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741568    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-node-log\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741587    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741595    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-sys\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741603    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-cnibin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741621    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-multus\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741644    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-kubelet-config\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741673    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-cni-multus\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741676    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-cnibin\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741688    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-node-log\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741704    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8c13245-bedc-4277-8989-8c585941e3c0-kubelet-config\") pod \"global-pull-secret-syncer-m67pw\" (UID: \"c8c13245-bedc-4277-8989-8c585941e3c0\") " pod="kube-system/global-pull-secret-syncer-m67pw"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741729    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741760    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysconfig\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741843    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-host-slash\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741845    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysconfig\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741862    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-kubernetes\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741877    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-conf\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741890    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88e7df41-2eb8-4dce-8a4f-0170ea4d12e4-host-slash\") pod \"iptables-alerter-bjkt7\" (UID: \"88e7df41-2eb8-4dce-8a4f-0170ea4d12e4\") " pod="openshift-network-operator/iptables-alerter-bjkt7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741891    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-run\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741929    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/813ebd55-ce29-4fde-931b-bd632c1b3658-crio-socket\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741952    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-socket-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741952    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-kubernetes\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741956    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-run\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741969    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741978    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-sysctl-conf\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.741993    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/813ebd55-ce29-4fde-931b-bd632c1b3658-crio-socket\") pod \"insights-runtime-extractor-bdn62\" (UID: \"813ebd55-ce29-4fde-931b-bd632c1b3658\") " pod="openshift-insights/insights-runtime-extractor-bdn62"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742004    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-openvswitch\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742013    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-socket-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742036    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-bin\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742051    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742067    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-var-lib-kubelet\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.742057 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742068    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-bin\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742103    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/459de48d-02fa-4213-9351-85502d870f39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8dvks\" (UID: \"459de48d-02fa-4213-9351-85502d870f39\") " pod="openshift-multus/multus-additional-cni-plugins-8dvks"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742104    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-var-lib-kubelet\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742116    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-etc-selinux\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742137    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-hostroot\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742140    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-etc-selinux\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742154    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-ovn\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742186    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-hostroot\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742185    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-root\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742208    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-multus-certs\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742216    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9b725795-a5f2-4b23-9429-d0bb34b56251-root\") pod \"node-exporter-rjnsj\" (UID: \"9b725795-a5f2-4b23-9429-d0bb34b56251\") " pod="openshift-monitoring/node-exporter-rjnsj"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742218    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-ovn\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742223    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-systemd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742241    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-run-multus-certs\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742252    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-run-systemd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742260    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742324    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742338    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-device-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742356    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-systemd\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742374    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742393    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-registration-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742419    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-log-socket\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742422    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-systemd\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742436    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742452    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-registration-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742461    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/939fc194-d0cf-4ee7-8db2-bcf14992affc-device-dir\") pod \"aws-ebs-csi-driver-node-vd25k\" (UID: \"939fc194-d0cf-4ee7-8db2-bcf14992affc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vd25k"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742482    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-log-socket\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742502    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-netd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742523    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-modprobe-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742550    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-kubelet\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742556    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ec9f5780-5d84-44be-bf3a-b3eb26d0808c-host-cni-netd\") pod \"ovnkube-node-cx9p7\" (UID: \"ec9f5780-5d84-44be-bf3a-b3eb26d0808c\") " pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742604    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a71ede-b75a-4381-8299-49e46083e654-host-var-lib-kubelet\") pod \"multus-nb2ld\" (UID: \"40a71ede-b75a-4381-8299-49e46083e654\") " pod="openshift-multus/multus-nb2ld"
Nov 01 03:43:00.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.742617    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/870f99e7-36f6-4e6e-b166-963313638a23-etc-modprobe-d\") pod \"tuned-9xmvl\" (UID: \"870f99e7-36f6-4e6e-b166-963313638a23\") " pod="openshift-cluster-node-tuning-operator/tuned-9xmvl"
Nov 01 03:43:00.776382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.776348    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:00.779482 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.779463    5529 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 03:43:00.999446 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:00.999412    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:01.003324 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:01.003299    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:02.746212 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:02.746153    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74f4d9d979-knqfv"
Nov 01 03:43:03.686476 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:03.686445    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:03.857357 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:03.857326    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:43:03.863211 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:03.863178    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-6c6fj"
Nov 01 03:43:03.916019 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:03.915971    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:03.921825 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:03.921794    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:04.446836 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:04.446803    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-blgfn"
Nov 01 03:43:04.478821 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:04.478793    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:43:05.002475 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:05.002441    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:05.018565 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:05.018530    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:06.470779 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:06.470299    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vvb6t" event={"ID":"e1db98a7-0a5c-498d-9682-4ec8cf74ddfb","Type":"ContainerStarted","Data":"e411455eae3531d9a681abbfb529aa3095a101001710b369b435537f3ee18a7c"}
Nov 01 03:43:07.593305 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:07.593272    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:07.789428 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:07.789340    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:08.382779 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:08.382747    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:09.589722 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:09.589692    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:09.590203 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:09.589874    5529 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 01 03:43:11.159926 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:11.159890    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:11.352731 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:11.352682    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:11.695060 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:11.695031    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gmh92"
Nov 01 03:43:13.415115 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:13.415075    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:13.616240 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:13.616200    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:13.819291 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:13.819194    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:14.017588 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:14.017553    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:14.282879 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:43:14.282844    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:43:15.406199 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:15.406145    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:15.607941 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:15.607905    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:17.584375 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:17.584344    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:17.794764 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:17.794733    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:18.483765 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:18.483724    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:19.376544 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:19.376510    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:19.595415 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:19.595384    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:21.549547 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:21.549509    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:21.773565 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:21.773528    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:23.926581 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:23.926549    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:23.930312 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:23.930288    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86b5876bbc-85f92"
Nov 01 03:43:26.997856 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:26.997822    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cx9p7"
Nov 01 03:43:27.991593 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:27.991562    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:43:31.913055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:31.913022    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:33.702210 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:33.702180    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:33.914526 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:33.914487    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:34.481396 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:34.481364    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wztb4"
Nov 01 03:43:44.282225 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:43:44.282181    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:43:44.445371 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:44.445338    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:44.642531 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:44.642503    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:43:46.193388 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:43:46.193357    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:44:00.392348 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:44:00.392310    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:44:00.593450 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:44:00.593419    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:44:00.918855 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:44:00.918821    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:44:14.282280 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:44:14.282239    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:44:18.027869 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:44:18.027839    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:44:18.226446 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:44:18.226403    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:44:28.006823 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:44:28.006795    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Nov 01 03:44:44.287452 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:44:44.287368    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:44:58.161144 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:44:58.161106    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:01.257663 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:01.257631    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:01.542103 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:01.542020    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:14.282786 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:45:14.282746    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:45:40.067431 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:40.067402    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:40.279687 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:40.279659    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:41.702242 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:41.702207    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:41.919763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:41.919731    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:42.747250 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.747219    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"]
Nov 01 03:45:42.751029 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.751001    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.810077 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.810043    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.810269 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.810083    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.810269 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.810222    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxl96\" (UniqueName: \"kubernetes.io/projected/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-kube-api-access-fxl96\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.854434 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.854398    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 01 03:45:42.854434 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.854398    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-q2z7d\""
Nov 01 03:45:42.854434 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.854444    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 01 03:45:42.855309 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.855290    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"]
Nov 01 03:45:42.855851 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.855830    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"]
Nov 01 03:45:42.859177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.859151    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:42.905374 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.905345    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"]
Nov 01 03:45:42.910945 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.910922    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.911036 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.910957    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:42.911036 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.910986    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.911036 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.911007    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kctdl\" (UniqueName: \"kubernetes.io/projected/f45d8acb-7f34-46be-8065-b4e682c00ac1-kube-api-access-kctdl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:42.911213 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.911105    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:42.911213 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.911141    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl96\" (UniqueName: \"kubernetes.io/projected/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-kube-api-access-fxl96\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.911425 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.911402    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.911492 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.911423    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.911907 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.911892    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-jvnm7\""
Nov 01 03:45:42.940936 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.940902    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"]
Nov 01 03:45:42.944398 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.944380    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:42.973281 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.973247    5529 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 01 03:45:42.975459 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.975440    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxl96\" (UniqueName: \"kubernetes.io/projected/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-kube-api-access-fxl96\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:42.999840 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:42.999749    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"]
Nov 01 03:45:43.012130 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012107    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:43.012253 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012144    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.012253 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012181    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.012253 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012205    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kctdl\" (UniqueName: \"kubernetes.io/projected/f45d8acb-7f34-46be-8065-b4e682c00ac1-kube-api-access-kctdl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:43.012425 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012405    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5vf9\" (UniqueName: \"kubernetes.io/projected/56117055-5af8-4315-9e0f-388b82b776de-kube-api-access-t5vf9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.012485 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012455    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:43.012575 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012556    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:43.012634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012613    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-qzpzb\""
Nov 01 03:45:43.012743 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.012727    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:43.038537 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.038505    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"]
Nov 01 03:45:43.042060 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.042038    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.046387 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.046363    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"]
Nov 01 03:45:43.049564 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.049546    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.057419 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.057395    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:43.067743 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.067726    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:45:43.075416 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.075394    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kctdl\" (UniqueName: \"kubernetes.io/projected/f45d8acb-7f34-46be-8065-b4e682c00ac1-kube-api-access-kctdl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:43.096948 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.096910    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"]
Nov 01 03:45:43.105434 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.105404    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"]
Nov 01 03:45:43.113410 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113381    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzs2m\" (UniqueName: \"kubernetes.io/projected/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-kube-api-access-jzs2m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.113561 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113496    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.113561 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113506    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-tgljt\""
Nov 01 03:45:43.113561 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113536    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.113707 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113559    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-7fgt8\""
Nov 01 03:45:43.113707 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113568    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5djb\" (UniqueName: \"kubernetes.io/projected/36d9a00d-3637-44be-bcd4-68b4ffd74368-kube-api-access-d5djb\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.113707 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113633    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.113707 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113690    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.113865 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113716    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.113865 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113762    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.113865 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.113794    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5vf9\" (UniqueName: \"kubernetes.io/projected/56117055-5af8-4315-9e0f-388b82b776de-kube-api-access-t5vf9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.114031 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.114013    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.114093 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.114072    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.176107 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.176073    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:45:43.176524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.176500    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5vf9\" (UniqueName: \"kubernetes.io/projected/56117055-5af8-4315-9e0f-388b82b776de-kube-api-access-t5vf9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.214308 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214273    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.214484 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214315    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5djb\" (UniqueName: \"kubernetes.io/projected/36d9a00d-3637-44be-bcd4-68b4ffd74368-kube-api-access-d5djb\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.214484 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214353    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.214484 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214391    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.214484 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214415    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.214770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214735    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.214843 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214772    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.214843 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214789    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzs2m\" (UniqueName: \"kubernetes.io/projected/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-kube-api-access-jzs2m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.214843 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214806    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.214998 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.214844    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.259737 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.259671    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:45:43.277211 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.277159    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzs2m\" (UniqueName: \"kubernetes.io/projected/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-kube-api-access-jzs2m\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.277404 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.277387    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5djb\" (UniqueName: \"kubernetes.io/projected/36d9a00d-3637-44be-bcd4-68b4ffd74368-kube-api-access-d5djb\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.357951 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.357917    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:45:43.364156 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.364129    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:45:43.443080 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.443051    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"]
Nov 01 03:45:43.449560 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:45:43.449530    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce62d27_a3e0_493c_993d_6fc6e6d1cbb1.slice/crio-7958e7d436e0cafabf1619fc3f64c054a820ae5e83af65bcda82795ebf62bc8e WatchSource:0}: Error finding container 7958e7d436e0cafabf1619fc3f64c054a820ae5e83af65bcda82795ebf62bc8e: Status 404 returned error can't find the container with id 7958e7d436e0cafabf1619fc3f64c054a820ae5e83af65bcda82795ebf62bc8e
Nov 01 03:45:43.548078 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.547996    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"]
Nov 01 03:45:43.553336 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:45:43.553305    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45d8acb_7f34_46be_8065_b4e682c00ac1.slice/crio-a442457c2b1148ed04872c0a043f6fd618c4071298c7e1ffd2e36f8713136c67 WatchSource:0}: Error finding container a442457c2b1148ed04872c0a043f6fd618c4071298c7e1ffd2e36f8713136c67: Status 404 returned error can't find the container with id a442457c2b1148ed04872c0a043f6fd618c4071298c7e1ffd2e36f8713136c67
Nov 01 03:45:43.631829 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.631796    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"]
Nov 01 03:45:43.635857 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:45:43.635825    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56117055_5af8_4315_9e0f_388b82b776de.slice/crio-5f5ac5741fdfe461b84a9a19da40575ed326ddf25dacfdc761cbdb9f506bf9cd WatchSource:0}: Error finding container 5f5ac5741fdfe461b84a9a19da40575ed326ddf25dacfdc761cbdb9f506bf9cd: Status 404 returned error can't find the container with id 5f5ac5741fdfe461b84a9a19da40575ed326ddf25dacfdc761cbdb9f506bf9cd
Nov 01 03:45:43.735817 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.735776    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"]
Nov 01 03:45:43.739917 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:45:43.739884    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d9a00d_3637_44be_bcd4_68b4ffd74368.slice/crio-e70f975e54ded42676daaf199babc027401de0041ccc9ca1ea06fe68f54b691f WatchSource:0}: Error finding container e70f975e54ded42676daaf199babc027401de0041ccc9ca1ea06fe68f54b691f: Status 404 returned error can't find the container with id e70f975e54ded42676daaf199babc027401de0041ccc9ca1ea06fe68f54b691f
Nov 01 03:45:43.742500 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.742476    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"]
Nov 01 03:45:43.746233 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:45:43.746212    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0e945e_c6a7_4d96_a9e3_bc25d776b627.slice/crio-a57cc2fc64c087c5eefa6aee0c3d897739675c5fe347937343ede5cda47db8b1 WatchSource:0}: Error finding container a57cc2fc64c087c5eefa6aee0c3d897739675c5fe347937343ede5cda47db8b1: Status 404 returned error can't find the container with id a57cc2fc64c087c5eefa6aee0c3d897739675c5fe347937343ede5cda47db8b1
Nov 01 03:45:43.985770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.985739    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"]
Nov 01 03:45:43.990462 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:43.990437    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.004237 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.004202    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq" event={"ID":"36d9a00d-3637-44be-bcd4-68b4ffd74368","Type":"ContainerStarted","Data":"e70f975e54ded42676daaf199babc027401de0041ccc9ca1ea06fe68f54b691f"}
Nov 01 03:45:44.005314 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.005294    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9" event={"ID":"f45d8acb-7f34-46be-8065-b4e682c00ac1","Type":"ContainerStarted","Data":"a442457c2b1148ed04872c0a043f6fd618c4071298c7e1ffd2e36f8713136c67"}
Nov 01 03:45:44.006418 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.006388    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4" event={"ID":"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1","Type":"ContainerStarted","Data":"7958e7d436e0cafabf1619fc3f64c054a820ae5e83af65bcda82795ebf62bc8e"}
Nov 01 03:45:44.007410 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.007391    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv" event={"ID":"56117055-5af8-4315-9e0f-388b82b776de","Type":"ContainerStarted","Data":"5f5ac5741fdfe461b84a9a19da40575ed326ddf25dacfdc761cbdb9f506bf9cd"}
Nov 01 03:45:44.008244 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.008226    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x" event={"ID":"cf0e945e-c6a7-4d96-a9e3-bc25d776b627","Type":"ContainerStarted","Data":"a57cc2fc64c087c5eefa6aee0c3d897739675c5fe347937343ede5cda47db8b1"}
Nov 01 03:45:44.043544 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.043503    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-cwk4z\""
Nov 01 03:45:44.044313 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.044290    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"]
Nov 01 03:45:44.126007 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.125971    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.126212 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.126086    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.126212 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.126128    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft7w8\" (UniqueName: \"kubernetes.io/projected/94cd8d07-600c-43e4-8034-cf8485339126-kube-api-access-ft7w8\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.227474 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.227431    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.227647 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.227502    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.227647 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.227526    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft7w8\" (UniqueName: \"kubernetes.io/projected/94cd8d07-600c-43e4-8034-cf8485339126-kube-api-access-ft7w8\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.227832 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.227812    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.227868 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.227851    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.282868 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:45:44.282785    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:45:44.289383 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.289356    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft7w8\" (UniqueName: \"kubernetes.io/projected/94cd8d07-600c-43e4-8034-cf8485339126-kube-api-access-ft7w8\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.307092 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.307060    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:45:44.683026 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:44.682992    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"]
Nov 01 03:45:44.687585 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:45:44.687553    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94cd8d07_600c_43e4_8034_cf8485339126.slice/crio-7af9ab9a7f95fdcbacff1b5ba1edfee9877ee2ec1f8ca2d3a4a02bbc48808363 WatchSource:0}: Error finding container 7af9ab9a7f95fdcbacff1b5ba1edfee9877ee2ec1f8ca2d3a4a02bbc48808363: Status 404 returned error can't find the container with id 7af9ab9a7f95fdcbacff1b5ba1edfee9877ee2ec1f8ca2d3a4a02bbc48808363
Nov 01 03:45:45.016387 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:45.016302    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj" event={"ID":"94cd8d07-600c-43e4-8034-cf8485339126","Type":"ContainerStarted","Data":"7af9ab9a7f95fdcbacff1b5ba1edfee9877ee2ec1f8ca2d3a4a02bbc48808363"}
Nov 01 03:45:46.806470 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:46.806434    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"]
Nov 01 03:45:46.810629 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:46.810555    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:46.868670 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:46.868637    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"]
Nov 01 03:45:46.914184 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:46.914135    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-4c85t\""
Nov 01 03:45:46.958946 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:46.958902    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:46.959143 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:46.959050    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:46.959143 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:46.959091    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4g22\" (UniqueName: \"kubernetes.io/projected/37f71bd4-a531-4e10-93d6-c54915b7094c-kube-api-access-j4g22\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:47.060199 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:47.060089    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:47.060199 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:47.060148    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4g22\" (UniqueName: \"kubernetes.io/projected/37f71bd4-a531-4e10-93d6-c54915b7094c-kube-api-access-j4g22\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:47.060509 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:47.060225    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:47.060774 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:47.060736    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:47.061001 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:47.060976    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:47.132740 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:47.132705    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4g22\" (UniqueName: \"kubernetes.io/projected/37f71bd4-a531-4e10-93d6-c54915b7094c-kube-api-access-j4g22\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:47.431424 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:47.431388    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:45:47.847915 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:47.847835    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"]
Nov 01 03:45:47.856972 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:45:47.856940    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f71bd4_a531_4e10_93d6_c54915b7094c.slice/crio-a30ac3b035452e8ba8f220548fe679080293fd73253327c19bb4519077e05938 WatchSource:0}: Error finding container a30ac3b035452e8ba8f220548fe679080293fd73253327c19bb4519077e05938: Status 404 returned error can't find the container with id a30ac3b035452e8ba8f220548fe679080293fd73253327c19bb4519077e05938
Nov 01 03:45:48.036995 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:48.036937    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2" event={"ID":"37f71bd4-a531-4e10-93d6-c54915b7094c","Type":"ContainerStarted","Data":"a30ac3b035452e8ba8f220548fe679080293fd73253327c19bb4519077e05938"}
Nov 01 03:45:48.105284 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:48.105204    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:48.314301 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:48.314267    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:49.491942 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:49.491892    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:49.700051 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:49.700006    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:49.931872 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:49.931760    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:50.439196 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.439138    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"]
Nov 01 03:45:50.444087 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.443511    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.500018 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.499941    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"]
Nov 01 03:45:50.550147 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.550109    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"]
Nov 01 03:45:50.555106 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.554959    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"]
Nov 01 03:45:50.555355 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.555068    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.561325 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.561302    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.574773 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.574742    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"]
Nov 01 03:45:50.596901 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.596839    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.597140 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.596910    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.597140 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.597003    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdbdn\" (UniqueName: \"kubernetes.io/projected/288b595a-ee34-4e7b-a339-a02086fccaec-kube-api-access-tdbdn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.598962 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.598932    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"]
Nov 01 03:45:50.697876 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.697796    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9wbt\" (UniqueName: \"kubernetes.io/projected/8f415f2d-1cff-41af-9895-9e065827c6de-kube-api-access-n9wbt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.697876 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.697835    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.697876 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.697867    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdbdn\" (UniqueName: \"kubernetes.io/projected/288b595a-ee34-4e7b-a339-a02086fccaec-kube-api-access-tdbdn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.698183 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.697909    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.698183 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.697943    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.698183 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.697965    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.698183 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.697984    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.698183 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.698001    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.698183 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.698022    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74jzc\" (UniqueName: \"kubernetes.io/projected/803ea82a-92a1-4bb1-b7ba-2017812d783a-kube-api-access-74jzc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.698654 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.698629    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.698716 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.698664    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.766666 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.766628    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdbdn\" (UniqueName: \"kubernetes.io/projected/288b595a-ee34-4e7b-a339-a02086fccaec-kube-api-access-tdbdn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.766850 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.766836    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:45:50.798849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.798818    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.798977 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.798868    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.798977 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.798901    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.798977 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.798937    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74jzc\" (UniqueName: \"kubernetes.io/projected/803ea82a-92a1-4bb1-b7ba-2017812d783a-kube-api-access-74jzc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.799139 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.798994    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9wbt\" (UniqueName: \"kubernetes.io/projected/8f415f2d-1cff-41af-9895-9e065827c6de-kube-api-access-n9wbt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.799139 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.799021    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.799460 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.799437    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.799797 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.799776    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.801217 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.801193    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.801453 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.801432    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.863695 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.863661    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9wbt\" (UniqueName: \"kubernetes.io/projected/8f415f2d-1cff-41af-9895-9e065827c6de-kube-api-access-n9wbt\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:50.864829 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.864804    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74jzc\" (UniqueName: \"kubernetes.io/projected/803ea82a-92a1-4bb1-b7ba-2017812d783a-kube-api-access-74jzc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.882673 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.882632    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:45:50.893575 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:50.893410    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:45:51.219121 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:51.219048    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"]
Nov 01 03:45:51.225212 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:45:51.225159    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288b595a_ee34_4e7b_a339_a02086fccaec.slice/crio-6912319684aa78e7c592e345b8558c0e3b8f20ff10cc8d5c0bc8f49d27ca0a65 WatchSource:0}: Error finding container 6912319684aa78e7c592e345b8558c0e3b8f20ff10cc8d5c0bc8f49d27ca0a65: Status 404 returned error can't find the container with id 6912319684aa78e7c592e345b8558c0e3b8f20ff10cc8d5c0bc8f49d27ca0a65
Nov 01 03:45:51.323837 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:51.323800    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"]
Nov 01 03:45:51.334893 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:51.334752    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"]
Nov 01 03:45:52.066939 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:52.066819    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq" event={"ID":"8f415f2d-1cff-41af-9895-9e065827c6de","Type":"ContainerStarted","Data":"1a9fc731ce0560b34b072e2b3a117395e6ee36236c09f0a1bf9f8156624afef0"}
Nov 01 03:45:52.073944 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:52.073809    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc" event={"ID":"288b595a-ee34-4e7b-a339-a02086fccaec","Type":"ContainerStarted","Data":"6912319684aa78e7c592e345b8558c0e3b8f20ff10cc8d5c0bc8f49d27ca0a65"}
Nov 01 03:45:52.075974 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:52.075896    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847" event={"ID":"803ea82a-92a1-4bb1-b7ba-2017812d783a","Type":"ContainerStarted","Data":"e4f82b3b3c5f4b494b7076672ceb277e46240f50512a8670f696c479af57b6d5"}
Nov 01 03:45:53.624885 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:45:53.624354    5529 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/9e/9ebc6a39f551b0fbcaa8f0a1db740467b49500027cd1b2efe5294e8aedac6049?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261101%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261101T034551Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=2e415ae429e7dc520675781e89b0b7729699d4c0e6b7d386191de9b5d34e3a4b&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793505651~hmac=401001169687864a1854f231fde55e7755bc921a947d6e9fe52ff746c0780b80\": EOF" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7f11145f2b45f37ba54929221d0de1581ca3b60e9234b4aa66e80003b2d611c3"
Nov 01 03:45:53.624885 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:45:53.624509    5529 kuberuntime_manager.go:1707] "Unhandled Error" err="init container util start failed in pod e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc_openshift-marketplace(288b595a-ee34-4e7b-a339-a02086fccaec): ErrImagePull: unable to pull image: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/9e/9ebc6a39f551b0fbcaa8f0a1db740467b49500027cd1b2efe5294e8aedac6049?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261101%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261101T034551Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=2e415ae429e7dc520675781e89b0b7729699d4c0e6b7d386191de9b5d34e3a4b&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793505651~hmac=401001169687864a1854f231fde55e7755bc921a947d6e9fe52ff746c0780b80\": EOF" logger="UnhandledError"
Nov 01 03:45:53.624885 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:45:53.624573    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"util\" with ErrImagePull: \"unable to pull image: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/9e/9ebc6a39f551b0fbcaa8f0a1db740467b49500027cd1b2efe5294e8aedac6049?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261101%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261101T034551Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=2e415ae429e7dc520675781e89b0b7729699d4c0e6b7d386191de9b5d34e3a4b&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793505651~hmac=401001169687864a1854f231fde55e7755bc921a947d6e9fe52ff746c0780b80\\\": EOF\"" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc" podUID="288b595a-ee34-4e7b-a339-a02086fccaec"
Nov 01 03:45:53.699429 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:53.699393    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:45:54.098561 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:45:54.098512    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"util\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7f11145f2b45f37ba54929221d0de1581ca3b60e9234b4aa66e80003b2d611c3\\\": ErrImagePull: unable to pull image: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/9e/9ebc6a39f551b0fbcaa8f0a1db740467b49500027cd1b2efe5294e8aedac6049?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20261101%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261101T034551Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=2e415ae429e7dc520675781e89b0b7729699d4c0e6b7d386191de9b5d34e3a4b&region=us-east-1&namespace=openshift-release-dev&username=openshift-release-dev+ocm_access_f62e7711b3d44085bacf45dd1a94949f&repo_name=ocp-v4.0-art-dev&akamai_signature=exp=1793505651~hmac=401001169687864a1854f231fde55e7755bc921a947d6e9fe52ff746c0780b80\\\": EOF\"" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc" podUID="288b595a-ee34-4e7b-a339-a02086fccaec"
Nov 01 03:45:59.139196 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:45:59.138830    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv" event={"ID":"56117055-5af8-4315-9e0f-388b82b776de","Type":"ContainerStarted","Data":"ba13bd916ce9b26165224b036252f95c94c272d8033706ce11c641a728bc1448"}
Nov 01 03:46:00.146352 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:00.146220    5529 generic.go:356] "Generic (PLEG): container finished" podID="56117055-5af8-4315-9e0f-388b82b776de" containerID="ba13bd916ce9b26165224b036252f95c94c272d8033706ce11c641a728bc1448" exitCode=0
Nov 01 03:46:00.146940 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:00.146906    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv" event={"ID":"56117055-5af8-4315-9e0f-388b82b776de","Type":"ContainerDied","Data":"ba13bd916ce9b26165224b036252f95c94c272d8033706ce11c641a728bc1448"}
Nov 01 03:46:00.151204 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:00.151106    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4" event={"ID":"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1","Type":"ContainerStarted","Data":"06971cb59413043a38473d2035547123cea1db129d6738d1f6a8a7010ca64b14"}
Nov 01 03:46:01.159886 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.159845    5529 generic.go:356] "Generic (PLEG): container finished" podID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerID="c588118dcb40a051dcf14cd8de8411fcab4fc01666e4d43bdbd3b6211255314d" exitCode=0
Nov 01 03:46:01.160352 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.159951    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x" event={"ID":"cf0e945e-c6a7-4d96-a9e3-bc25d776b627","Type":"ContainerDied","Data":"c588118dcb40a051dcf14cd8de8411fcab4fc01666e4d43bdbd3b6211255314d"}
Nov 01 03:46:01.163092 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.162891    5529 generic.go:356] "Generic (PLEG): container finished" podID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerID="06971cb59413043a38473d2035547123cea1db129d6738d1f6a8a7010ca64b14" exitCode=0
Nov 01 03:46:01.163222 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.163099    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4" event={"ID":"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1","Type":"ContainerDied","Data":"06971cb59413043a38473d2035547123cea1db129d6738d1f6a8a7010ca64b14"}
Nov 01 03:46:01.167215 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.166142    5529 generic.go:356] "Generic (PLEG): container finished" podID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerID="1e61c462f1b8235707f24fda6dccdbda58ec93cd85ccccea80ed253ff08895a1" exitCode=0
Nov 01 03:46:01.167215 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.166279    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq" event={"ID":"36d9a00d-3637-44be-bcd4-68b4ffd74368","Type":"ContainerDied","Data":"1e61c462f1b8235707f24fda6dccdbda58ec93cd85ccccea80ed253ff08895a1"}
Nov 01 03:46:01.169542 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.169516    5529 generic.go:356] "Generic (PLEG): container finished" podID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerID="1ef896565a8896f43f5742bcccaf6bc241895d7be52e50c2d2465a1c9772b283" exitCode=0
Nov 01 03:46:01.169643 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.169593    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9" event={"ID":"f45d8acb-7f34-46be-8065-b4e682c00ac1","Type":"ContainerDied","Data":"1ef896565a8896f43f5742bcccaf6bc241895d7be52e50c2d2465a1c9772b283"}
Nov 01 03:46:01.610744 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:01.610656    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:02.181560 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:02.181474    5529 generic.go:356] "Generic (PLEG): container finished" podID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerID="90de506cd924c0d09fdd54567136fe284167216167ebe419857ead764d85a08c" exitCode=0
Nov 01 03:46:02.181560 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:02.181535    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847" event={"ID":"803ea82a-92a1-4bb1-b7ba-2017812d783a","Type":"ContainerDied","Data":"90de506cd924c0d09fdd54567136fe284167216167ebe419857ead764d85a08c"}
Nov 01 03:46:02.183376 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:02.183240    5529 generic.go:356] "Generic (PLEG): container finished" podID="8f415f2d-1cff-41af-9895-9e065827c6de" containerID="e9c1cf7d546c8eb770322e7611a5e44841d683092757044cd6b04fb9798caf46" exitCode=0
Nov 01 03:46:02.183376 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:02.183271    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq" event={"ID":"8f415f2d-1cff-41af-9895-9e065827c6de","Type":"ContainerDied","Data":"e9c1cf7d546c8eb770322e7611a5e44841d683092757044cd6b04fb9798caf46"}
Nov 01 03:46:02.185235 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:02.185120    5529 generic.go:356] "Generic (PLEG): container finished" podID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerID="10d8e28971ecd83269e529a2a4894c9248410eadc19a6f76a4fc4490dc5acd33" exitCode=0
Nov 01 03:46:02.185235 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:02.185172    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2" event={"ID":"37f71bd4-a531-4e10-93d6-c54915b7094c","Type":"ContainerDied","Data":"10d8e28971ecd83269e529a2a4894c9248410eadc19a6f76a4fc4490dc5acd33"}
Nov 01 03:46:03.192795 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:03.192766    5529 generic.go:356] "Generic (PLEG): container finished" podID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerID="0cb5b0eeb368542ad596be4d58f0d7a11030e22893e4f8e46d7945a25305cbb6" exitCode=0
Nov 01 03:46:03.193263 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:03.192806    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq" event={"ID":"36d9a00d-3637-44be-bcd4-68b4ffd74368","Type":"ContainerDied","Data":"0cb5b0eeb368542ad596be4d58f0d7a11030e22893e4f8e46d7945a25305cbb6"}
Nov 01 03:46:04.199111 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:04.199073    5529 generic.go:356] "Generic (PLEG): container finished" podID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerID="8966179d3723f4713ded85c8510220ece8e7827a96e327fd8f2eb302c1eceaf9" exitCode=0
Nov 01 03:46:04.199574 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:04.199150    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x" event={"ID":"cf0e945e-c6a7-4d96-a9e3-bc25d776b627","Type":"ContainerDied","Data":"8966179d3723f4713ded85c8510220ece8e7827a96e327fd8f2eb302c1eceaf9"}
Nov 01 03:46:04.201147 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:04.201123    5529 generic.go:356] "Generic (PLEG): container finished" podID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerID="b11e39b03e2d9f9bff97ff18227982770f33b162a385e93fb4c96ebd686c7c4f" exitCode=0
Nov 01 03:46:04.201285 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:04.201201    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847" event={"ID":"803ea82a-92a1-4bb1-b7ba-2017812d783a","Type":"ContainerDied","Data":"b11e39b03e2d9f9bff97ff18227982770f33b162a385e93fb4c96ebd686c7c4f"}
Nov 01 03:46:04.204805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:04.203945    5529 generic.go:356] "Generic (PLEG): container finished" podID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerID="f21840a186fa66575aa2a5688c49cdf9a934518918bea5a4846142354c4d31c9" exitCode=0
Nov 01 03:46:04.204805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:04.203991    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9" event={"ID":"f45d8acb-7f34-46be-8065-b4e682c00ac1","Type":"ContainerDied","Data":"f21840a186fa66575aa2a5688c49cdf9a934518918bea5a4846142354c4d31c9"}
Nov 01 03:46:05.215066 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:05.215034    5529 generic.go:356] "Generic (PLEG): container finished" podID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerID="8f4acf7792d7ade215d9a2cbc15a7a4323fc6f95c69677d33634be474fd4d32e" exitCode=0
Nov 01 03:46:05.215555 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:05.215119    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4" event={"ID":"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1","Type":"ContainerDied","Data":"8f4acf7792d7ade215d9a2cbc15a7a4323fc6f95c69677d33634be474fd4d32e"}
Nov 01 03:46:05.221991 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:05.221959    5529 generic.go:356] "Generic (PLEG): container finished" podID="94cd8d07-600c-43e4-8034-cf8485339126" containerID="6b43ed29ffcdb23c81951e734f0e32cadab88fb54613f9ca8992737952536c8b" exitCode=0
Nov 01 03:46:05.222114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:05.222062    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj" event={"ID":"94cd8d07-600c-43e4-8034-cf8485339126","Type":"ContainerDied","Data":"6b43ed29ffcdb23c81951e734f0e32cadab88fb54613f9ca8992737952536c8b"}
Nov 01 03:46:05.230903 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:05.230211    5529 generic.go:356] "Generic (PLEG): container finished" podID="8f415f2d-1cff-41af-9895-9e065827c6de" containerID="b7e8dd8189f16387e3f69e672d53d9eee85c8cb5e6a7ba4d8aa7b12ebfe1a6da" exitCode=0
Nov 01 03:46:05.230903 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:05.230255    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq" event={"ID":"8f415f2d-1cff-41af-9895-9e065827c6de","Type":"ContainerDied","Data":"b7e8dd8189f16387e3f69e672d53d9eee85c8cb5e6a7ba4d8aa7b12ebfe1a6da"}
Nov 01 03:46:06.240850 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:06.240813    5529 generic.go:356] "Generic (PLEG): container finished" podID="288b595a-ee34-4e7b-a339-a02086fccaec" containerID="7d2c50e9fe263f5f48bd5c236b53b3800e5bd922cf3d681e7627feed50d24c5b" exitCode=0
Nov 01 03:46:06.241486 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:06.240888    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc" event={"ID":"288b595a-ee34-4e7b-a339-a02086fccaec","Type":"ContainerDied","Data":"7d2c50e9fe263f5f48bd5c236b53b3800e5bd922cf3d681e7627feed50d24c5b"}
Nov 01 03:46:07.263407 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:07.262528    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2" event={"ID":"37f71bd4-a531-4e10-93d6-c54915b7094c","Type":"ContainerStarted","Data":"647a2a5bb9cf2196ad07edd4795eb4e2db25ff8be193d221c85e7e734b0355f6"}
Nov 01 03:46:07.269647 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:07.268886    5529 generic.go:356] "Generic (PLEG): container finished" podID="288b595a-ee34-4e7b-a339-a02086fccaec" containerID="2b9f000303858b39abc9bde33aef623d8a756be2028b99229aef658fdc7146b1" exitCode=0
Nov 01 03:46:07.269647 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:07.268948    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc" event={"ID":"288b595a-ee34-4e7b-a339-a02086fccaec","Type":"ContainerDied","Data":"2b9f000303858b39abc9bde33aef623d8a756be2028b99229aef658fdc7146b1"}
Nov 01 03:46:08.291132 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:08.291097    5529 generic.go:356] "Generic (PLEG): container finished" podID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerID="647a2a5bb9cf2196ad07edd4795eb4e2db25ff8be193d221c85e7e734b0355f6" exitCode=0
Nov 01 03:46:08.291603 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:08.291225    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2" event={"ID":"37f71bd4-a531-4e10-93d6-c54915b7094c","Type":"ContainerDied","Data":"647a2a5bb9cf2196ad07edd4795eb4e2db25ff8be193d221c85e7e734b0355f6"}
Nov 01 03:46:09.312989 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:09.312946    5529 generic.go:356] "Generic (PLEG): container finished" podID="56117055-5af8-4315-9e0f-388b82b776de" containerID="99efeda65d82d6bbcd50cae53b206a7c89d5f7cb66421e821f9bd90dab050133" exitCode=0
Nov 01 03:46:09.313591 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:09.313035    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv" event={"ID":"56117055-5af8-4315-9e0f-388b82b776de","Type":"ContainerDied","Data":"99efeda65d82d6bbcd50cae53b206a7c89d5f7cb66421e821f9bd90dab050133"}
Nov 01 03:46:14.305156 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:46:14.305113    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:46:14.372829 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:14.372778    5529 generic.go:356] "Generic (PLEG): container finished" podID="94cd8d07-600c-43e4-8034-cf8485339126" containerID="c01f511296fe8e53439eeeee3838f292b2a1e7a9eff8e21e1bd7b60b7d9a09e7" exitCode=0
Nov 01 03:46:14.372995 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:14.372896    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj" event={"ID":"94cd8d07-600c-43e4-8034-cf8485339126","Type":"ContainerDied","Data":"c01f511296fe8e53439eeeee3838f292b2a1e7a9eff8e21e1bd7b60b7d9a09e7"}
Nov 01 03:46:22.014426 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:22.014222    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:22.223785 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:22.223695    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:22.469115 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:22.469074    5529 generic.go:356] "Generic (PLEG): container finished" podID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerID="f8fcc5d48aa195963d7be2a59cc2255c860212237f45f6301bb1e02ba5654a1e" exitCode=0
Nov 01 03:46:22.469578 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:22.469340    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq" event={"ID":"36d9a00d-3637-44be-bcd4-68b4ffd74368","Type":"ContainerDied","Data":"f8fcc5d48aa195963d7be2a59cc2255c860212237f45f6301bb1e02ba5654a1e"}
Nov 01 03:46:23.482595 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.482199    5529 generic.go:356] "Generic (PLEG): container finished" podID="56117055-5af8-4315-9e0f-388b82b776de" containerID="2a1048c1c37b0d075d57e924130a75242e70d744a2c580259166f5063e11f9de" exitCode=0
Nov 01 03:46:23.482595 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.482518    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv" event={"ID":"56117055-5af8-4315-9e0f-388b82b776de","Type":"ContainerDied","Data":"2a1048c1c37b0d075d57e924130a75242e70d744a2c580259166f5063e11f9de"}
Nov 01 03:46:23.681925 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.681890    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:46:23.752300 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.752208    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-bundle\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-bundle\") pod \"36d9a00d-3637-44be-bcd4-68b4ffd74368\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") "
Nov 01 03:46:23.752300 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.752290    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-util\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-util\") pod \"36d9a00d-3637-44be-bcd4-68b4ffd74368\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") "
Nov 01 03:46:23.752607 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.752379    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36d9a00d-3637-44be-bcd4-68b4ffd74368-kube-api-access-d5djb\" (UniqueName: \"kubernetes.io/projected/36d9a00d-3637-44be-bcd4-68b4ffd74368-kube-api-access-d5djb\") pod \"36d9a00d-3637-44be-bcd4-68b4ffd74368\" (UID: \"36d9a00d-3637-44be-bcd4-68b4ffd74368\") "
Nov 01 03:46:23.753316 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.753282    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-bundle" pod "36d9a00d-3637-44be-bcd4-68b4ffd74368" (UID: "36d9a00d-3637-44be-bcd4-68b4ffd74368"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:23.755544 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.755475    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d9a00d-3637-44be-bcd4-68b4ffd74368-kube-api-access-d5djb" pod "36d9a00d-3637-44be-bcd4-68b4ffd74368" (UID: "36d9a00d-3637-44be-bcd4-68b4ffd74368"). InnerVolumeSpecName "kube-api-access-d5djb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:23.759207 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.759176    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-util" pod "36d9a00d-3637-44be-bcd4-68b4ffd74368" (UID: "36d9a00d-3637-44be-bcd4-68b4ffd74368"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:23.853488 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.853451    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5djb\" (UniqueName: \"kubernetes.io/projected/36d9a00d-3637-44be-bcd4-68b4ffd74368-kube-api-access-d5djb\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:23.853488 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.853490    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:23.853722 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:23.853505    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36d9a00d-3637-44be-bcd4-68b4ffd74368-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:24.504189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.497978    5529 generic.go:356] "Generic (PLEG): container finished" podID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerID="60e554c6eefdad8b958476092df2a2bb618a51c023fdd8678827fee1d2de909f" exitCode=0
Nov 01 03:46:24.504189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.498090    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x" event={"ID":"cf0e945e-c6a7-4d96-a9e3-bc25d776b627","Type":"ContainerDied","Data":"60e554c6eefdad8b958476092df2a2bb618a51c023fdd8678827fee1d2de909f"}
Nov 01 03:46:24.504763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.504465    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq" event={"ID":"36d9a00d-3637-44be-bcd4-68b4ffd74368","Type":"ContainerDied","Data":"e70f975e54ded42676daaf199babc027401de0041ccc9ca1ea06fe68f54b691f"}
Nov 01 03:46:24.504763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.504516    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e70f975e54ded42676daaf199babc027401de0041ccc9ca1ea06fe68f54b691f"
Nov 01 03:46:24.504763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.504603    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71fqxrq"
Nov 01 03:46:24.509297 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.509261    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847" event={"ID":"803ea82a-92a1-4bb1-b7ba-2017812d783a","Type":"ContainerStarted","Data":"6c1f968c04efc8cab93fc1a1dbfa49049a035d0c184d0edce67cace59b78a0b2"}
Nov 01 03:46:24.690540 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.690417    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:46:24.764111 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.763511    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-util\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-util\") pod \"56117055-5af8-4315-9e0f-388b82b776de\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") "
Nov 01 03:46:24.764111 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.763639    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56117055-5af8-4315-9e0f-388b82b776de-kube-api-access-t5vf9\" (UniqueName: \"kubernetes.io/projected/56117055-5af8-4315-9e0f-388b82b776de-kube-api-access-t5vf9\") pod \"56117055-5af8-4315-9e0f-388b82b776de\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") "
Nov 01 03:46:24.764111 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.763695    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-bundle\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-bundle\") pod \"56117055-5af8-4315-9e0f-388b82b776de\" (UID: \"56117055-5af8-4315-9e0f-388b82b776de\") "
Nov 01 03:46:24.765078 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.765018    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-bundle" pod "56117055-5af8-4315-9e0f-388b82b776de" (UID: "56117055-5af8-4315-9e0f-388b82b776de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:24.767102 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.767061    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56117055-5af8-4315-9e0f-388b82b776de-kube-api-access-t5vf9" pod "56117055-5af8-4315-9e0f-388b82b776de" (UID: "56117055-5af8-4315-9e0f-388b82b776de"). InnerVolumeSpecName "kube-api-access-t5vf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:24.769351 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.769325    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-util" pod "56117055-5af8-4315-9e0f-388b82b776de" (UID: "56117055-5af8-4315-9e0f-388b82b776de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:24.864690 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.864654    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:24.864690 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.864691    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56117055-5af8-4315-9e0f-388b82b776de-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:24.864937 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:24.864705    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5vf9\" (UniqueName: \"kubernetes.io/projected/56117055-5af8-4315-9e0f-388b82b776de-kube-api-access-t5vf9\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:25.520278 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.520191    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4" event={"ID":"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1","Type":"ContainerStarted","Data":"dc8f056dab204401b5899f345e31577695b3e1ddbbd553b7bf1d25af2b616aa1"}
Nov 01 03:46:25.522932 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.522906    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv"
Nov 01 03:46:25.523478 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.523451    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fpqjv" event={"ID":"56117055-5af8-4315-9e0f-388b82b776de","Type":"ContainerDied","Data":"5f5ac5741fdfe461b84a9a19da40575ed326ddf25dacfdc761cbdb9f506bf9cd"}
Nov 01 03:46:25.523628 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.523495    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f5ac5741fdfe461b84a9a19da40575ed326ddf25dacfdc761cbdb9f506bf9cd"
Nov 01 03:46:25.526822 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.526795    5529 generic.go:356] "Generic (PLEG): container finished" podID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerID="6c1f968c04efc8cab93fc1a1dbfa49049a035d0c184d0edce67cace59b78a0b2" exitCode=0
Nov 01 03:46:25.526942 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.526865    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847" event={"ID":"803ea82a-92a1-4bb1-b7ba-2017812d783a","Type":"ContainerDied","Data":"6c1f968c04efc8cab93fc1a1dbfa49049a035d0c184d0edce67cace59b78a0b2"}
Nov 01 03:46:25.530276 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.530249    5529 generic.go:356] "Generic (PLEG): container finished" podID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerID="6b15465f1de6d48ffb37c0207429b3f04fd1809665a133f905200f55a9a18748" exitCode=0
Nov 01 03:46:25.530382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.530334    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9" event={"ID":"f45d8acb-7f34-46be-8065-b4e682c00ac1","Type":"ContainerDied","Data":"6b15465f1de6d48ffb37c0207429b3f04fd1809665a133f905200f55a9a18748"}
Nov 01 03:46:25.644251 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.642184    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4" podStartSLOduration=4.148403179 podStartE2EDuration="43.642147294s" totalImagesPullingTime="39.493744115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:45:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:46:25.641025822 +0000 UTC m=+206.400753618" watchObservedRunningTime="2026-11-01 03:46:25.642147294 +0000 UTC m=+206.401875089"
Nov 01 03:46:25.744572 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.744474    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:46:25.754796 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.754759    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:46:25.876363 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.876330    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-kube-api-access-jzs2m\" (UniqueName: \"kubernetes.io/projected/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-kube-api-access-jzs2m\") pod \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") "
Nov 01 03:46:25.876549 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.876390    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-bundle\") pod \"803ea82a-92a1-4bb1-b7ba-2017812d783a\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") "
Nov 01 03:46:25.876549 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.876500    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/803ea82a-92a1-4bb1-b7ba-2017812d783a-kube-api-access-74jzc\" (UniqueName: \"kubernetes.io/projected/803ea82a-92a1-4bb1-b7ba-2017812d783a-kube-api-access-74jzc\") pod \"803ea82a-92a1-4bb1-b7ba-2017812d783a\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") "
Nov 01 03:46:25.876549 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.876529    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-util\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-util\") pod \"803ea82a-92a1-4bb1-b7ba-2017812d783a\" (UID: \"803ea82a-92a1-4bb1-b7ba-2017812d783a\") "
Nov 01 03:46:25.876719 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.876571    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-util\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-util\") pod \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") "
Nov 01 03:46:25.876719 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.876610    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-bundle\") pod \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\" (UID: \"cf0e945e-c6a7-4d96-a9e3-bc25d776b627\") "
Nov 01 03:46:25.877710 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.877661    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-bundle" pod "cf0e945e-c6a7-4d96-a9e3-bc25d776b627" (UID: "cf0e945e-c6a7-4d96-a9e3-bc25d776b627"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:25.880107 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.880073    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-bundle" pod "803ea82a-92a1-4bb1-b7ba-2017812d783a" (UID: "803ea82a-92a1-4bb1-b7ba-2017812d783a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:25.880662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.880638    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803ea82a-92a1-4bb1-b7ba-2017812d783a-kube-api-access-74jzc" pod "803ea82a-92a1-4bb1-b7ba-2017812d783a" (UID: "803ea82a-92a1-4bb1-b7ba-2017812d783a"). InnerVolumeSpecName "kube-api-access-74jzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:25.883650 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.883611    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-util" pod "cf0e945e-c6a7-4d96-a9e3-bc25d776b627" (UID: "cf0e945e-c6a7-4d96-a9e3-bc25d776b627"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:25.884028 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.884004    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-util" pod "803ea82a-92a1-4bb1-b7ba-2017812d783a" (UID: "803ea82a-92a1-4bb1-b7ba-2017812d783a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:25.889342 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.885686    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-kube-api-access-jzs2m" pod "cf0e945e-c6a7-4d96-a9e3-bc25d776b627" (UID: "cf0e945e-c6a7-4d96-a9e3-bc25d776b627"). InnerVolumeSpecName "kube-api-access-jzs2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:25.977333 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.977306    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:25.977445 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.977336    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74jzc\" (UniqueName: \"kubernetes.io/projected/803ea82a-92a1-4bb1-b7ba-2017812d783a-kube-api-access-74jzc\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:25.977445 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.977347    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ea82a-92a1-4bb1-b7ba-2017812d783a-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:25.977445 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.977356    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:25.977445 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.977363    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:25.977445 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:25.977374    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzs2m\" (UniqueName: \"kubernetes.io/projected/cf0e945e-c6a7-4d96-a9e3-bc25d776b627-kube-api-access-jzs2m\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:26.537595 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.537504    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq" event={"ID":"8f415f2d-1cff-41af-9895-9e065827c6de","Type":"ContainerStarted","Data":"183289c8d6d20fdddca1d5c22b8841e26765b9c001be7cc479cd50f742705b16"}
Nov 01 03:46:26.539648 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.539621    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x"
Nov 01 03:46:26.539759 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.539624    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4chk78x" event={"ID":"cf0e945e-c6a7-4d96-a9e3-bc25d776b627","Type":"ContainerDied","Data":"a57cc2fc64c087c5eefa6aee0c3d897739675c5fe347937343ede5cda47db8b1"}
Nov 01 03:46:26.539759 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.539723    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a57cc2fc64c087c5eefa6aee0c3d897739675c5fe347937343ede5cda47db8b1"
Nov 01 03:46:26.541989 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.541964    5529 generic.go:356] "Generic (PLEG): container finished" podID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerID="dc8f056dab204401b5899f345e31577695b3e1ddbbd553b7bf1d25af2b616aa1" exitCode=0
Nov 01 03:46:26.542104 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.542071    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4" event={"ID":"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1","Type":"ContainerDied","Data":"dc8f056dab204401b5899f345e31577695b3e1ddbbd553b7bf1d25af2b616aa1"}
Nov 01 03:46:26.544382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.544358    5529 generic.go:356] "Generic (PLEG): container finished" podID="94cd8d07-600c-43e4-8034-cf8485339126" containerID="d37c0e11373c3ff59363861c77f5e2e1498336e5a0a4941089f8bfcfddb3f7b2" exitCode=0
Nov 01 03:46:26.544497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.544435    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj" event={"ID":"94cd8d07-600c-43e4-8034-cf8485339126","Type":"ContainerDied","Data":"d37c0e11373c3ff59363861c77f5e2e1498336e5a0a4941089f8bfcfddb3f7b2"}
Nov 01 03:46:26.546244 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.546219    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847" event={"ID":"803ea82a-92a1-4bb1-b7ba-2017812d783a","Type":"ContainerDied","Data":"e4f82b3b3c5f4b494b7076672ceb277e46240f50512a8670f696c479af57b6d5"}
Nov 01 03:46:26.546334 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.546248    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d754847"
Nov 01 03:46:26.546334 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.546261    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4f82b3b3c5f4b494b7076672ceb277e46240f50512a8670f696c479af57b6d5"
Nov 01 03:46:26.699798 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.699765    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:46:26.776971 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.776893    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq" podStartSLOduration=3.403846287 podStartE2EDuration="36.776877927s" totalImagesPullingTime="33.37303164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:45:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:46:26.657834892 +0000 UTC m=+207.417562686" watchObservedRunningTime="2026-11-01 03:46:26.776877927 +0000 UTC m=+207.536605722"
Nov 01 03:46:26.784868 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.784842    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-util\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-util\") pod \"f45d8acb-7f34-46be-8065-b4e682c00ac1\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") "
Nov 01 03:46:26.785003 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.784902    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f45d8acb-7f34-46be-8065-b4e682c00ac1-kube-api-access-kctdl\" (UniqueName: \"kubernetes.io/projected/f45d8acb-7f34-46be-8065-b4e682c00ac1-kube-api-access-kctdl\") pod \"f45d8acb-7f34-46be-8065-b4e682c00ac1\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") "
Nov 01 03:46:26.785003 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.784942    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-bundle\") pod \"f45d8acb-7f34-46be-8065-b4e682c00ac1\" (UID: \"f45d8acb-7f34-46be-8065-b4e682c00ac1\") "
Nov 01 03:46:26.785470 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.785441    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-bundle" pod "f45d8acb-7f34-46be-8065-b4e682c00ac1" (UID: "f45d8acb-7f34-46be-8065-b4e682c00ac1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:26.786999 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.786976    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45d8acb-7f34-46be-8065-b4e682c00ac1-kube-api-access-kctdl" pod "f45d8acb-7f34-46be-8065-b4e682c00ac1" (UID: "f45d8acb-7f34-46be-8065-b4e682c00ac1"). InnerVolumeSpecName "kube-api-access-kctdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:26.790416 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.790392    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-util" pod "f45d8acb-7f34-46be-8065-b4e682c00ac1" (UID: "f45d8acb-7f34-46be-8065-b4e682c00ac1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:26.885766 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.885729    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:26.885766 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.885763    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kctdl\" (UniqueName: \"kubernetes.io/projected/f45d8acb-7f34-46be-8065-b4e682c00ac1-kube-api-access-kctdl\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:26.885766 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:26.885773    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f45d8acb-7f34-46be-8065-b4e682c00ac1-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:27.553229 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.553116    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2" event={"ID":"37f71bd4-a531-4e10-93d6-c54915b7094c","Type":"ContainerStarted","Data":"15778589c58298a7613bf9d9e0922b42dcec656f45d896cead03ea057a23aedf"}
Nov 01 03:46:27.555197 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.555155    5529 generic.go:356] "Generic (PLEG): container finished" podID="288b595a-ee34-4e7b-a339-a02086fccaec" containerID="8aca0cb5a2a519d9e426057805f9dec9b368a8922ba32f823ec3c56e8a336a37" exitCode=0
Nov 01 03:46:27.555314 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.555202    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc" event={"ID":"288b595a-ee34-4e7b-a339-a02086fccaec","Type":"ContainerDied","Data":"8aca0cb5a2a519d9e426057805f9dec9b368a8922ba32f823ec3c56e8a336a37"}
Nov 01 03:46:27.557149 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.557131    5529 generic.go:356] "Generic (PLEG): container finished" podID="8f415f2d-1cff-41af-9895-9e065827c6de" containerID="183289c8d6d20fdddca1d5c22b8841e26765b9c001be7cc479cd50f742705b16" exitCode=0
Nov 01 03:46:27.557284 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.557199    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq" event={"ID":"8f415f2d-1cff-41af-9895-9e065827c6de","Type":"ContainerDied","Data":"183289c8d6d20fdddca1d5c22b8841e26765b9c001be7cc479cd50f742705b16"}
Nov 01 03:46:27.558809 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.558790    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9" event={"ID":"f45d8acb-7f34-46be-8065-b4e682c00ac1","Type":"ContainerDied","Data":"a442457c2b1148ed04872c0a043f6fd618c4071298c7e1ffd2e36f8713136c67"}
Nov 01 03:46:27.559064 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.558826    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a442457c2b1148ed04872c0a043f6fd618c4071298c7e1ffd2e36f8713136c67"
Nov 01 03:46:27.559715 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.559149    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dgzt9"
Nov 01 03:46:27.671217 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.671193    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:46:27.672674 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.672618    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2" podStartSLOduration=3.695992859 podStartE2EDuration="41.672599696s" totalImagesPullingTime="37.976606837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:45:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:46:27.671111956 +0000 UTC m=+208.430839750" watchObservedRunningTime="2026-11-01 03:46:27.672599696 +0000 UTC m=+208.432327491"
Nov 01 03:46:27.705804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.705783    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:46:27.793366 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.793334    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-kube-api-access-fxl96\" (UniqueName: \"kubernetes.io/projected/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-kube-api-access-fxl96\") pod \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") "
Nov 01 03:46:27.793555 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.793398    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-bundle\") pod \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") "
Nov 01 03:46:27.793555 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.793498    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-util\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-util\") pod \"94cd8d07-600c-43e4-8034-cf8485339126\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") "
Nov 01 03:46:27.793555 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.793540    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94cd8d07-600c-43e4-8034-cf8485339126-kube-api-access-ft7w8\" (UniqueName: \"kubernetes.io/projected/94cd8d07-600c-43e4-8034-cf8485339126-kube-api-access-ft7w8\") pod \"94cd8d07-600c-43e4-8034-cf8485339126\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") "
Nov 01 03:46:27.793737 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.793570    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-util\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-util\") pod \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\" (UID: \"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1\") "
Nov 01 03:46:27.793737 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.793587    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-bundle\") pod \"94cd8d07-600c-43e4-8034-cf8485339126\" (UID: \"94cd8d07-600c-43e4-8034-cf8485339126\") "
Nov 01 03:46:27.794063 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.794035    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-bundle" pod "94cd8d07-600c-43e4-8034-cf8485339126" (UID: "94cd8d07-600c-43e4-8034-cf8485339126"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:27.794226 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.794197    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-bundle" pod "dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" (UID: "dce62d27-a3e0-493c-993d-6fc6e6d1cbb1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:27.795780 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.795756    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94cd8d07-600c-43e4-8034-cf8485339126-kube-api-access-ft7w8" pod "94cd8d07-600c-43e4-8034-cf8485339126" (UID: "94cd8d07-600c-43e4-8034-cf8485339126"). InnerVolumeSpecName "kube-api-access-ft7w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:27.795866 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.795813    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-kube-api-access-fxl96" pod "dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" (UID: "dce62d27-a3e0-493c-993d-6fc6e6d1cbb1"). InnerVolumeSpecName "kube-api-access-fxl96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:27.800385 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.800364    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-util" pod "94cd8d07-600c-43e4-8034-cf8485339126" (UID: "94cd8d07-600c-43e4-8034-cf8485339126"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:27.801877 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.801834    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-util" pod "dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" (UID: "dce62d27-a3e0-493c-993d-6fc6e6d1cbb1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:27.894826 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.894795    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft7w8\" (UniqueName: \"kubernetes.io/projected/94cd8d07-600c-43e4-8034-cf8485339126-kube-api-access-ft7w8\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:27.894826 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.894822    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:27.894826 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.894831    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:27.895054 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.894840    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxl96\" (UniqueName: \"kubernetes.io/projected/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-kube-api-access-fxl96\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:27.895054 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.894849    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dce62d27-a3e0-493c-993d-6fc6e6d1cbb1-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:27.895054 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:27.894857    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94cd8d07-600c-43e4-8034-cf8485339126-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:28.564779 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.564741    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4" event={"ID":"dce62d27-a3e0-493c-993d-6fc6e6d1cbb1","Type":"ContainerDied","Data":"7958e7d436e0cafabf1619fc3f64c054a820ae5e83af65bcda82795ebf62bc8e"}
Nov 01 03:46:28.564779 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.564766    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847azv4z4"
Nov 01 03:46:28.565306 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.564796    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7958e7d436e0cafabf1619fc3f64c054a820ae5e83af65bcda82795ebf62bc8e"
Nov 01 03:46:28.567261 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.567233    5529 generic.go:356] "Generic (PLEG): container finished" podID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerID="15778589c58298a7613bf9d9e0922b42dcec656f45d896cead03ea057a23aedf" exitCode=0
Nov 01 03:46:28.567493 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.567295    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2" event={"ID":"37f71bd4-a531-4e10-93d6-c54915b7094c","Type":"ContainerDied","Data":"15778589c58298a7613bf9d9e0922b42dcec656f45d896cead03ea057a23aedf"}
Nov 01 03:46:28.569679 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.569665    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj"
Nov 01 03:46:28.569767 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.569695    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644kjtnj" event={"ID":"94cd8d07-600c-43e4-8034-cf8485339126","Type":"ContainerDied","Data":"7af9ab9a7f95fdcbacff1b5ba1edfee9877ee2ec1f8ca2d3a4a02bbc48808363"}
Nov 01 03:46:28.569767 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.569734    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7af9ab9a7f95fdcbacff1b5ba1edfee9877ee2ec1f8ca2d3a4a02bbc48808363"
Nov 01 03:46:28.727122 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.727094    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:46:28.753562 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.753539    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:46:28.803684 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.803653    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-util\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-util\") pod \"8f415f2d-1cff-41af-9895-9e065827c6de\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") "
Nov 01 03:46:28.803835 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.803717    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/288b595a-ee34-4e7b-a339-a02086fccaec-kube-api-access-tdbdn\" (UniqueName: \"kubernetes.io/projected/288b595a-ee34-4e7b-a339-a02086fccaec-kube-api-access-tdbdn\") pod \"288b595a-ee34-4e7b-a339-a02086fccaec\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") "
Nov 01 03:46:28.803835 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.803748    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f415f2d-1cff-41af-9895-9e065827c6de-kube-api-access-n9wbt\" (UniqueName: \"kubernetes.io/projected/8f415f2d-1cff-41af-9895-9e065827c6de-kube-api-access-n9wbt\") pod \"8f415f2d-1cff-41af-9895-9e065827c6de\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") "
Nov 01 03:46:28.803835 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.803780    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-bundle\") pod \"8f415f2d-1cff-41af-9895-9e065827c6de\" (UID: \"8f415f2d-1cff-41af-9895-9e065827c6de\") "
Nov 01 03:46:28.803835 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.803821    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-util\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-util\") pod \"288b595a-ee34-4e7b-a339-a02086fccaec\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") "
Nov 01 03:46:28.804023 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.803866    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-bundle\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-bundle\") pod \"288b595a-ee34-4e7b-a339-a02086fccaec\" (UID: \"288b595a-ee34-4e7b-a339-a02086fccaec\") "
Nov 01 03:46:28.804543 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.804504    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-bundle" pod "288b595a-ee34-4e7b-a339-a02086fccaec" (UID: "288b595a-ee34-4e7b-a339-a02086fccaec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:28.804667 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.804636    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-bundle" pod "8f415f2d-1cff-41af-9895-9e065827c6de" (UID: "8f415f2d-1cff-41af-9895-9e065827c6de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:28.806010 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.805984    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f415f2d-1cff-41af-9895-9e065827c6de-kube-api-access-n9wbt" pod "8f415f2d-1cff-41af-9895-9e065827c6de" (UID: "8f415f2d-1cff-41af-9895-9e065827c6de"). InnerVolumeSpecName "kube-api-access-n9wbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:28.806239 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.806218    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288b595a-ee34-4e7b-a339-a02086fccaec-kube-api-access-tdbdn" pod "288b595a-ee34-4e7b-a339-a02086fccaec" (UID: "288b595a-ee34-4e7b-a339-a02086fccaec"). InnerVolumeSpecName "kube-api-access-tdbdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:28.809562 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.809535    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-util" pod "288b595a-ee34-4e7b-a339-a02086fccaec" (UID: "288b595a-ee34-4e7b-a339-a02086fccaec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:28.810346 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.810319    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-util" pod "8f415f2d-1cff-41af-9895-9e065827c6de" (UID: "8f415f2d-1cff-41af-9895-9e065827c6de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:28.905371 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.905338    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdbdn\" (UniqueName: \"kubernetes.io/projected/288b595a-ee34-4e7b-a339-a02086fccaec-kube-api-access-tdbdn\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:28.905371 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.905368    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9wbt\" (UniqueName: \"kubernetes.io/projected/8f415f2d-1cff-41af-9895-9e065827c6de-kube-api-access-n9wbt\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:28.905552 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.905399    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:28.905552 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.905410    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:28.905552 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.905418    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/288b595a-ee34-4e7b-a339-a02086fccaec-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:28.905552 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:28.905428    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f415f2d-1cff-41af-9895-9e065827c6de-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:29.574659 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.574630    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq"
Nov 01 03:46:29.575147 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.574680    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6bxnq" event={"ID":"8f415f2d-1cff-41af-9895-9e065827c6de","Type":"ContainerDied","Data":"1a9fc731ce0560b34b072e2b3a117395e6ee36236c09f0a1bf9f8156624afef0"}
Nov 01 03:46:29.575147 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.574725    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a9fc731ce0560b34b072e2b3a117395e6ee36236c09f0a1bf9f8156624afef0"
Nov 01 03:46:29.576673 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.576634    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc"
Nov 01 03:46:29.576673 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.576654    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cddfmc" event={"ID":"288b595a-ee34-4e7b-a339-a02086fccaec","Type":"ContainerDied","Data":"6912319684aa78e7c592e345b8558c0e3b8f20ff10cc8d5c0bc8f49d27ca0a65"}
Nov 01 03:46:29.576886 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.576701    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6912319684aa78e7c592e345b8558c0e3b8f20ff10cc8d5c0bc8f49d27ca0a65"
Nov 01 03:46:29.697433 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.697408    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:46:29.812394 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.812352    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-bundle\") pod \"37f71bd4-a531-4e10-93d6-c54915b7094c\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") "
Nov 01 03:46:29.812585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.812528    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37f71bd4-a531-4e10-93d6-c54915b7094c-kube-api-access-j4g22\" (UniqueName: \"kubernetes.io/projected/37f71bd4-a531-4e10-93d6-c54915b7094c-kube-api-access-j4g22\") pod \"37f71bd4-a531-4e10-93d6-c54915b7094c\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") "
Nov 01 03:46:29.812585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.812560    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-util\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-util\") pod \"37f71bd4-a531-4e10-93d6-c54915b7094c\" (UID: \"37f71bd4-a531-4e10-93d6-c54915b7094c\") "
Nov 01 03:46:29.813359 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.813298    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-bundle" pod "37f71bd4-a531-4e10-93d6-c54915b7094c" (UID: "37f71bd4-a531-4e10-93d6-c54915b7094c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:29.814912 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.814881    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f71bd4-a531-4e10-93d6-c54915b7094c-kube-api-access-j4g22" pod "37f71bd4-a531-4e10-93d6-c54915b7094c" (UID: "37f71bd4-a531-4e10-93d6-c54915b7094c"). InnerVolumeSpecName "kube-api-access-j4g22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:46:29.818755 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.818728    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-util" pod "37f71bd4-a531-4e10-93d6-c54915b7094c" (UID: "37f71bd4-a531-4e10-93d6-c54915b7094c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:46:29.913826 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.913788    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4g22\" (UniqueName: \"kubernetes.io/projected/37f71bd4-a531-4e10-93d6-c54915b7094c-kube-api-access-j4g22\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:29.913826 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.913823    5529 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-util\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:29.913826 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:29.913833    5529 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37f71bd4-a531-4e10-93d6-c54915b7094c-bundle\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:46:30.582570 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:30.582536    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2" event={"ID":"37f71bd4-a531-4e10-93d6-c54915b7094c","Type":"ContainerDied","Data":"a30ac3b035452e8ba8f220548fe679080293fd73253327c19bb4519077e05938"}
Nov 01 03:46:30.582973 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:30.582573    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cbbzf2"
Nov 01 03:46:30.582973 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:30.582583    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a30ac3b035452e8ba8f220548fe679080293fd73253327c19bb4519077e05938"
Nov 01 03:46:30.980067 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:30.980030    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:32.107273 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107239    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"]
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107516    5529 cpu_manager.go:414] "containerMap: removing container" podUID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerName="pull"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107527    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerName="pull"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107537    5529 cpu_manager.go:414] "containerMap: removing container" podUID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerName="extract"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107542    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerName="extract"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107552    5529 cpu_manager.go:414] "containerMap: removing container" podUID="8f415f2d-1cff-41af-9895-9e065827c6de" containerName="pull"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107556    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f415f2d-1cff-41af-9895-9e065827c6de" containerName="pull"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107566    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107571    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107579    5529 cpu_manager.go:414] "containerMap: removing container" podUID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107584    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107589    5529 cpu_manager.go:414] "containerMap: removing container" podUID="94cd8d07-600c-43e4-8034-cf8485339126" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107593    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94cd8d07-600c-43e4-8034-cf8485339126" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107599    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerName="extract"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107603    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerName="extract"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107624    5529 cpu_manager.go:414] "containerMap: removing container" podUID="8f415f2d-1cff-41af-9895-9e065827c6de" containerName="extract"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107629    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f415f2d-1cff-41af-9895-9e065827c6de" containerName="extract"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107637    5529 cpu_manager.go:414] "containerMap: removing container" podUID="56117055-5af8-4315-9e0f-388b82b776de" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107642    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56117055-5af8-4315-9e0f-388b82b776de" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107649    5529 cpu_manager.go:414] "containerMap: removing container" podUID="8f415f2d-1cff-41af-9895-9e065827c6de" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107653    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f415f2d-1cff-41af-9895-9e065827c6de" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107661    5529 cpu_manager.go:414] "containerMap: removing container" podUID="288b595a-ee34-4e7b-a339-a02086fccaec" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107666    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="288b595a-ee34-4e7b-a339-a02086fccaec" containerName="util"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107671    5529 cpu_manager.go:414] "containerMap: removing container" podUID="56117055-5af8-4315-9e0f-388b82b776de" containerName="extract"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107675    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56117055-5af8-4315-9e0f-388b82b776de" containerName="extract"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107682    5529 cpu_manager.go:414] "containerMap: removing container" podUID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerName="pull"
Nov 01 03:46:32.107683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107687    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107700    5529 cpu_manager.go:414] "containerMap: removing container" podUID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107704    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107710    5529 cpu_manager.go:414] "containerMap: removing container" podUID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerName="util"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107714    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerName="util"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107720    5529 cpu_manager.go:414] "containerMap: removing container" podUID="94cd8d07-600c-43e4-8034-cf8485339126" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107724    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94cd8d07-600c-43e4-8034-cf8485339126" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107733    5529 cpu_manager.go:414] "containerMap: removing container" podUID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107737    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107746    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107751    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107757    5529 cpu_manager.go:414] "containerMap: removing container" podUID="288b595a-ee34-4e7b-a339-a02086fccaec" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107761    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="288b595a-ee34-4e7b-a339-a02086fccaec" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107767    5529 cpu_manager.go:414] "containerMap: removing container" podUID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107771    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107779    5529 cpu_manager.go:414] "containerMap: removing container" podUID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerName="util"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107784    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerName="util"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107789    5529 cpu_manager.go:414] "containerMap: removing container" podUID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerName="util"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107793    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerName="util"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107798    5529 cpu_manager.go:414] "containerMap: removing container" podUID="56117055-5af8-4315-9e0f-388b82b776de" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107802    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56117055-5af8-4315-9e0f-388b82b776de" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107808    5529 cpu_manager.go:414] "containerMap: removing container" podUID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107812    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107819    5529 cpu_manager.go:414] "containerMap: removing container" podUID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107823    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107828    5529 cpu_manager.go:414] "containerMap: removing container" podUID="288b595a-ee34-4e7b-a339-a02086fccaec" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107833    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="288b595a-ee34-4e7b-a339-a02086fccaec" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107841    5529 cpu_manager.go:414] "containerMap: removing container" podUID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107846    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107851    5529 cpu_manager.go:414] "containerMap: removing container" podUID="94cd8d07-600c-43e4-8034-cf8485339126" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107855    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94cd8d07-600c-43e4-8034-cf8485339126" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107862    5529 cpu_manager.go:414] "containerMap: removing container" podUID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerName="util"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107866    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerName="util"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107871    5529 cpu_manager.go:414] "containerMap: removing container" podUID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107876    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerName="pull"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107920    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="36d9a00d-3637-44be-bcd4-68b4ffd74368" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107928    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="f45d8acb-7f34-46be-8065-b4e682c00ac1" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107933    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f415f2d-1cff-41af-9895-9e065827c6de" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107940    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="56117055-5af8-4315-9e0f-388b82b776de" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107946    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="37f71bd4-a531-4e10-93d6-c54915b7094c" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107953    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="94cd8d07-600c-43e4-8034-cf8485339126" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107958    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf0e945e-c6a7-4d96-a9e3-bc25d776b627" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107963    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="803ea82a-92a1-4bb1-b7ba-2017812d783a" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107969    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="288b595a-ee34-4e7b-a339-a02086fccaec" containerName="extract"
Nov 01 03:46:32.108585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.107974    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="dce62d27-a3e0-493c-993d-6fc6e6d1cbb1" containerName="extract"
Nov 01 03:46:32.109989 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.109977    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.163322 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.163295    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 01 03:46:32.163536 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.163481    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 01 03:46:32.163536 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.163489    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 01 03:46:32.213189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.213144    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 01 03:46:32.213427 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.213159    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-t7bc9\""
Nov 01 03:46:32.213427 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.213205    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 01 03:46:32.215532 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.215509    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"]
Nov 01 03:46:32.233111 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.233078    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.233261 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.233117    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3196b473-fbac-4839-9211-9fb82c267e86-manifests\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.233261 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.233241    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.233338 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.233284    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j658m\" (UniqueName: \"kubernetes.io/projected/3196b473-fbac-4839-9211-9fb82c267e86-kube-api-access-j658m\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.233338 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.233317    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3196b473-fbac-4839-9211-9fb82c267e86-tmp\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.233457 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.233435    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-metrics-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.334248 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.334210    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.334447 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.334258    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j658m\" (UniqueName: \"kubernetes.io/projected/3196b473-fbac-4839-9211-9fb82c267e86-kube-api-access-j658m\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.334513 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.334441    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3196b473-fbac-4839-9211-9fb82c267e86-tmp\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.334513 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.334477    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-metrics-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.334617 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.334519    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.334617 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.334553    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3196b473-fbac-4839-9211-9fb82c267e86-manifests\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.334967 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.334940    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3196b473-fbac-4839-9211-9fb82c267e86-manifests\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.336796 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.336767    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3196b473-fbac-4839-9211-9fb82c267e86-tmp\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.336917 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.336803    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.336917 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.336866    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-metrics-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.336996 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.336950    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3196b473-fbac-4839-9211-9fb82c267e86-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.396651 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.396613    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j658m\" (UniqueName: \"kubernetes.io/projected/3196b473-fbac-4839-9211-9fb82c267e86-kube-api-access-j658m\") pod \"opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw\" (UID: \"3196b473-fbac-4839-9211-9fb82c267e86\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.422516 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.422480    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:32.887520 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.887487    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:32.916966 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:32.916935    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"]
Nov 01 03:46:32.920750 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:46:32.920727    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3196b473_fbac_4839_9211_9fb82c267e86.slice/crio-8ca20d8da678caeeec6509563496ab8057a0edf3189136d3668b9296f515843b WatchSource:0}: Error finding container 8ca20d8da678caeeec6509563496ab8057a0edf3189136d3668b9296f515843b: Status 404 returned error can't find the container with id 8ca20d8da678caeeec6509563496ab8057a0edf3189136d3668b9296f515843b
Nov 01 03:46:33.596753 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:33.596720    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw" event={"ID":"3196b473-fbac-4839-9211-9fb82c267e86","Type":"ContainerStarted","Data":"8ca20d8da678caeeec6509563496ab8057a0edf3189136d3668b9296f515843b"}
Nov 01 03:46:35.006319 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:35.006283    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:35.616069 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:35.616033    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:36.175446 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:36.175392    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:37.417201 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:37.417144    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:37.656211 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:37.656153    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:38.621414 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:38.621369    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw" event={"ID":"3196b473-fbac-4839-9211-9fb82c267e86","Type":"ContainerStarted","Data":"b92f8b2c5335942678b8b7069c0ed623009aa92f04b0a76f5eb676755cc9a963"}
Nov 01 03:46:39.201524 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:39.201485    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:39.405050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:39.405020    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:39.627153 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:39.627122    5529 generic.go:356] "Generic (PLEG): container finished" podID="3196b473-fbac-4839-9211-9fb82c267e86" containerID="b92f8b2c5335942678b8b7069c0ed623009aa92f04b0a76f5eb676755cc9a963" exitCode=0
Nov 01 03:46:39.627532 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:39.627189    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw" event={"ID":"3196b473-fbac-4839-9211-9fb82c267e86","Type":"ContainerDied","Data":"b92f8b2c5335942678b8b7069c0ed623009aa92f04b0a76f5eb676755cc9a963"}
Nov 01 03:46:40.633860 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:40.633832    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw" event={"ID":"3196b473-fbac-4839-9211-9fb82c267e86","Type":"ContainerStarted","Data":"0a6d10d8f6e39a56cd41f2b74804e326f89027e8a56a662ef7008218a58097b7"}
Nov 01 03:46:40.634263 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:40.634000    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:40.873856 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:40.873810    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw" podStartSLOduration=2.923372634 podStartE2EDuration="9.873795453s" totalImagesPullingTime="6.463474591s" totalInitContainerRuntime="486.948228ms" isStatefulPod=false podCreationTimestamp="2026-11-01 03:46:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:46:40.823759905 +0000 UTC m=+221.583487697" watchObservedRunningTime="2026-11-01 03:46:40.873795453 +0000 UTC m=+221.633523238"
Nov 01 03:46:41.984326 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:41.984294    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"]
Nov 01 03:46:41.987473 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:41.987456    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"
Nov 01 03:46:42.091292 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.091256    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-lgsvd\""
Nov 01 03:46:42.092683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.092661    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"]
Nov 01 03:46:42.126089 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.126054    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8ddde29-dacc-4f61-b84e-33d8a0c46ae4-tmp\") pod \"jobset-operator-674cd59dc5-srlkk\" (UID: \"b8ddde29-dacc-4f61-b84e-33d8a0c46ae4\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"
Nov 01 03:46:42.126269 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.126118    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plrpw\" (UniqueName: \"kubernetes.io/projected/b8ddde29-dacc-4f61-b84e-33d8a0c46ae4-kube-api-access-plrpw\") pod \"jobset-operator-674cd59dc5-srlkk\" (UID: \"b8ddde29-dacc-4f61-b84e-33d8a0c46ae4\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"
Nov 01 03:46:42.141587 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.141564    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 01 03:46:42.141587 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.141582    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 01 03:46:42.227126 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.227091    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8ddde29-dacc-4f61-b84e-33d8a0c46ae4-tmp\") pod \"jobset-operator-674cd59dc5-srlkk\" (UID: \"b8ddde29-dacc-4f61-b84e-33d8a0c46ae4\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"
Nov 01 03:46:42.227310 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.227145    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plrpw\" (UniqueName: \"kubernetes.io/projected/b8ddde29-dacc-4f61-b84e-33d8a0c46ae4-kube-api-access-plrpw\") pod \"jobset-operator-674cd59dc5-srlkk\" (UID: \"b8ddde29-dacc-4f61-b84e-33d8a0c46ae4\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"
Nov 01 03:46:42.227522 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.227502    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8ddde29-dacc-4f61-b84e-33d8a0c46ae4-tmp\") pod \"jobset-operator-674cd59dc5-srlkk\" (UID: \"b8ddde29-dacc-4f61-b84e-33d8a0c46ae4\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"
Nov 01 03:46:42.289004 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.288925    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plrpw\" (UniqueName: \"kubernetes.io/projected/b8ddde29-dacc-4f61-b84e-33d8a0c46ae4-kube-api-access-plrpw\") pod \"jobset-operator-674cd59dc5-srlkk\" (UID: \"b8ddde29-dacc-4f61-b84e-33d8a0c46ae4\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"
Nov 01 03:46:42.311905 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.311874    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"
Nov 01 03:46:42.683575 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:42.683545    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk"]
Nov 01 03:46:42.687153 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:46:42.687126    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8ddde29_dacc_4f61_b84e_33d8a0c46ae4.slice/crio-013c096480fe46811a8b38c68454f5825b78d6a5aba2ffb738bf6ccbc0f39aa8 WatchSource:0}: Error finding container 013c096480fe46811a8b38c68454f5825b78d6a5aba2ffb738bf6ccbc0f39aa8: Status 404 returned error can't find the container with id 013c096480fe46811a8b38c68454f5825b78d6a5aba2ffb738bf6ccbc0f39aa8
Nov 01 03:46:43.648799 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.648760    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk" event={"ID":"b8ddde29-dacc-4f61-b84e-33d8a0c46ae4","Type":"ContainerStarted","Data":"013c096480fe46811a8b38c68454f5825b78d6a5aba2ffb738bf6ccbc0f39aa8"}
Nov 01 03:46:43.733307 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.733271    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"]
Nov 01 03:46:43.739221 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.739198    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:43.778220 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.778188    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"]
Nov 01 03:46:43.826835 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.826797    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 01 03:46:43.826835 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.826798    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 01 03:46:43.826835 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.826810    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-77scm\""
Nov 01 03:46:43.840214 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.840185    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pngcr\" (UID: \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:43.840341 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.840218    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kdzh\" (UniqueName: \"kubernetes.io/projected/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-kube-api-access-7kdzh\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pngcr\" (UID: \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:43.940906 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.940823    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pngcr\" (UID: \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:43.940906 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.940860    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kdzh\" (UniqueName: \"kubernetes.io/projected/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-kube-api-access-7kdzh\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pngcr\" (UID: \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:43.941241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:43.941218    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pngcr\" (UID: \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:44.007469 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:44.007437    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kdzh\" (UniqueName: \"kubernetes.io/projected/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-kube-api-access-7kdzh\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pngcr\" (UID: \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:44.052306 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:44.052273    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:44.170959 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:44.170920    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:44.282613 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:46:44.282518    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:46:44.536863 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:44.536793    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"]
Nov 01 03:46:44.540246 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:46:44.540219    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf179e4ed_3bb6_4d78_8de0_f9ec6cf65f2e.slice/crio-f4eba874d730a099110e5fd525904426c66c8fa1d75ab5af3db604caa241afdf WatchSource:0}: Error finding container f4eba874d730a099110e5fd525904426c66c8fa1d75ab5af3db604caa241afdf: Status 404 returned error can't find the container with id f4eba874d730a099110e5fd525904426c66c8fa1d75ab5af3db604caa241afdf
Nov 01 03:46:44.654421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:44.654391    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr" event={"ID":"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e","Type":"ContainerStarted","Data":"f4eba874d730a099110e5fd525904426c66c8fa1d75ab5af3db604caa241afdf"}
Nov 01 03:46:44.974151 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:44.974121    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:45.699878 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:45.699845    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:45.915946 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:45.915909    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:46.595691 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:46.595653    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:47.704711 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:47.704672    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:47.910273 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:47.910230    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:49.127404 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:49.127372    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:49.328086 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:49.328052    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:49.880691 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:49.880650    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:50.243874 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.243798    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:50.658790 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.658752    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"]
Nov 01 03:46:50.686546 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.686520    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"
Nov 01 03:46:50.703560 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.703530    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"]
Nov 01 03:46:50.752146 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.752114    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Nov 01 03:46:50.752146 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.752116    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Nov 01 03:46:50.752375 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.752238    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vjsd6\""
Nov 01 03:46:50.802770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.802733    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c06c0b84-d063-48cf-a69b-422edb7d6059-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-fn29x\" (UID: \"c06c0b84-d063-48cf-a69b-422edb7d6059\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"
Nov 01 03:46:50.802951 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.802784    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9blpl\" (UniqueName: \"kubernetes.io/projected/c06c0b84-d063-48cf-a69b-422edb7d6059-kube-api-access-9blpl\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-fn29x\" (UID: \"c06c0b84-d063-48cf-a69b-422edb7d6059\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"
Nov 01 03:46:50.904107 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.904082    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c06c0b84-d063-48cf-a69b-422edb7d6059-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-fn29x\" (UID: \"c06c0b84-d063-48cf-a69b-422edb7d6059\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"
Nov 01 03:46:50.904251 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.904135    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9blpl\" (UniqueName: \"kubernetes.io/projected/c06c0b84-d063-48cf-a69b-422edb7d6059-kube-api-access-9blpl\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-fn29x\" (UID: \"c06c0b84-d063-48cf-a69b-422edb7d6059\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"
Nov 01 03:46:50.904506 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.904485    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c06c0b84-d063-48cf-a69b-422edb7d6059-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-fn29x\" (UID: \"c06c0b84-d063-48cf-a69b-422edb7d6059\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"
Nov 01 03:46:50.967870 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:50.967789    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9blpl\" (UniqueName: \"kubernetes.io/projected/c06c0b84-d063-48cf-a69b-422edb7d6059-kube-api-access-9blpl\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-fn29x\" (UID: \"c06c0b84-d063-48cf-a69b-422edb7d6059\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"
Nov 01 03:46:51.024505 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:51.024465    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"
Nov 01 03:46:51.530181 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:51.530139    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x"]
Nov 01 03:46:51.535114 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:46:51.535077    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06c0b84_d063_48cf_a69b_422edb7d6059.slice/crio-fac8ddd3e817d824988b57f50bc23d5fe67e60a6818093c1deadceac7f2f44e4 WatchSource:0}: Error finding container fac8ddd3e817d824988b57f50bc23d5fe67e60a6818093c1deadceac7f2f44e4: Status 404 returned error can't find the container with id fac8ddd3e817d824988b57f50bc23d5fe67e60a6818093c1deadceac7f2f44e4
Nov 01 03:46:51.641312 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:51.641283    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6bd4ff4fb8-bhmqw"
Nov 01 03:46:51.698523 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:51.698484    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x" event={"ID":"c06c0b84-d063-48cf-a69b-422edb7d6059","Type":"ContainerStarted","Data":"fac8ddd3e817d824988b57f50bc23d5fe67e60a6818093c1deadceac7f2f44e4"}
Nov 01 03:46:51.700029 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:51.700001    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk" event={"ID":"b8ddde29-dacc-4f61-b84e-33d8a0c46ae4","Type":"ContainerStarted","Data":"7dfa15c5fc851c0d299f718a3237964da877507d68b26ca1cd6667bfc6eddce7"}
Nov 01 03:46:51.963454 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:51.963392    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-srlkk" podStartSLOduration=2.838122221 podStartE2EDuration="10.963372182s" totalImagesPullingTime="8.125249961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:46:51.961990576 +0000 UTC m=+232.721718371" watchObservedRunningTime="2026-11-01 03:46:51.963372182 +0000 UTC m=+232.723099978"
Nov 01 03:46:52.678448 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:52.678411    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:52.964273 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:52.964194    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:53.168866 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.168832    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:53.260426 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.260350    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"]
Nov 01 03:46:53.263194 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.263177    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"
Nov 01 03:46:53.320777 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.320744    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"]
Nov 01 03:46:53.321677 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.321652    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88kq\" (UniqueName: \"kubernetes.io/projected/76ea97fd-b3bf-44b7-bf14-7ff151a0122a-kube-api-access-d88kq\") pod \"limitador-operator-controller-manager-5778bb4449-9bqsl\" (UID: \"76ea97fd-b3bf-44b7-bf14-7ff151a0122a\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"
Nov 01 03:46:53.368631 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.368600    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cq9g5\""
Nov 01 03:46:53.422698 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.422665    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d88kq\" (UniqueName: \"kubernetes.io/projected/76ea97fd-b3bf-44b7-bf14-7ff151a0122a-kube-api-access-d88kq\") pod \"limitador-operator-controller-manager-5778bb4449-9bqsl\" (UID: \"76ea97fd-b3bf-44b7-bf14-7ff151a0122a\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"
Nov 01 03:46:53.488923 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.488893    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88kq\" (UniqueName: \"kubernetes.io/projected/76ea97fd-b3bf-44b7-bf14-7ff151a0122a-kube-api-access-d88kq\") pod \"limitador-operator-controller-manager-5778bb4449-9bqsl\" (UID: \"76ea97fd-b3bf-44b7-bf14-7ff151a0122a\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"
Nov 01 03:46:53.574371 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.574288    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"
Nov 01 03:46:53.952302 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:53.952262    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"]
Nov 01 03:46:53.956401 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:46:53.956370    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ea97fd_b3bf_44b7_bf14_7ff151a0122a.slice/crio-56f50cbacebc1f7ffc695b5222fd1f353a762dee213a1739df9cce9a04849f62 WatchSource:0}: Error finding container 56f50cbacebc1f7ffc695b5222fd1f353a762dee213a1739df9cce9a04849f62: Status 404 returned error can't find the container with id 56f50cbacebc1f7ffc695b5222fd1f353a762dee213a1739df9cce9a04849f62
Nov 01 03:46:54.262502 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:54.262419    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:54.717826 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:54.717787    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x" event={"ID":"c06c0b84-d063-48cf-a69b-422edb7d6059","Type":"ContainerStarted","Data":"58ed39515ec4affe716b72e03da5d99bb36b80ba0ac67a7e6dd599c907ac031d"}
Nov 01 03:46:54.719115 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:54.719091    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl" event={"ID":"76ea97fd-b3bf-44b7-bf14-7ff151a0122a","Type":"ContainerStarted","Data":"56f50cbacebc1f7ffc695b5222fd1f353a762dee213a1739df9cce9a04849f62"}
Nov 01 03:46:54.940886 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:54.940830    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-fn29x" podStartSLOduration=1.929065786 podStartE2EDuration="4.94081362s" totalImagesPullingTime="3.011747834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:46:54.889987183 +0000 UTC m=+235.649714978" watchObservedRunningTime="2026-11-01 03:46:54.94081362 +0000 UTC m=+235.700541415"
Nov 01 03:46:55.022526 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:55.022476    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:56.384304 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:56.384268    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:56.627351 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:56.627320    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:56.733561 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:56.733508    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr" event={"ID":"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e","Type":"ContainerStarted","Data":"45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c"}
Nov 01 03:46:56.968640 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:56.968536    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr" podStartSLOduration=1.884286466 podStartE2EDuration="13.968522808s" totalImagesPullingTime="12.084236342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:46:56.91805093 +0000 UTC m=+237.677778725" watchObservedRunningTime="2026-11-01 03:46:56.968522808 +0000 UTC m=+237.728250602"
Nov 01 03:46:57.123592 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:57.123554    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:57.738706 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:57.738671    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:46:58.741294 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:58.741264    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:46:58.745263 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:58.745235    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl" event={"ID":"76ea97fd-b3bf-44b7-bf14-7ff151a0122a","Type":"ContainerStarted","Data":"12a0bc9c7c3d83d60a5251a7f3835c22cf6139da3dce6e082ba8100ef850b761"}
Nov 01 03:46:58.745576 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:58.745558    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"
Nov 01 03:46:58.869002 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:58.868946    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl" podStartSLOduration=1.938647482 podStartE2EDuration="5.868929561s" totalImagesPullingTime="3.930282079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:46:58.867355544 +0000 UTC m=+239.627083339" watchObservedRunningTime="2026-11-01 03:46:58.868929561 +0000 UTC m=+239.628657357"
Nov 01 03:46:59.229643 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:46:59.229607    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:00.982804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:00.982756    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:01.181945 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.181913    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:01.381550 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.381490    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:01.583868 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.583834    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:01.788576 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.788495    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:01.976061 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.976024    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"]
Nov 01 03:47:01.981007 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.980986    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:01.991786 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.991756    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk5gs\" (UniqueName: \"kubernetes.io/projected/a8c56eb0-d56d-48ff-855c-e745490e3112-kube-api-access-jk5gs\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:01.992205 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.991800    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c56eb0-d56d-48ff-855c-e745490e3112-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:01.992205 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.991914    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8c56eb0-d56d-48ff-855c-e745490e3112-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:01.992558 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:01.992536    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:02.037567 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.037539    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"]
Nov 01 03:47:02.086353 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.086265    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Nov 01 03:47:02.086353 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.086270    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z76k2\""
Nov 01 03:47:02.086353 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.086334    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Nov 01 03:47:02.092774 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.092732    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8c56eb0-d56d-48ff-855c-e745490e3112-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:02.092862 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.092827    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk5gs\" (UniqueName: \"kubernetes.io/projected/a8c56eb0-d56d-48ff-855c-e745490e3112-kube-api-access-jk5gs\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:02.092862 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.092852    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c56eb0-d56d-48ff-855c-e745490e3112-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:02.093420 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.093394    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8c56eb0-d56d-48ff-855c-e745490e3112-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:02.095393 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.095369    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c56eb0-d56d-48ff-855c-e745490e3112-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:02.154581 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.154549    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk5gs\" (UniqueName: \"kubernetes.io/projected/a8c56eb0-d56d-48ff-855c-e745490e3112-kube-api-access-jk5gs\") pod \"kuadrant-console-plugin-66c4fb575d-sbxm2\" (UID: \"a8c56eb0-d56d-48ff-855c-e745490e3112\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:02.209736 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.209672    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:02.292915 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.292876    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"
Nov 01 03:47:02.526304 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.526264    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:02.665593 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.665564    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2"]
Nov 01 03:47:02.668595 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:47:02.668565    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8c56eb0_d56d_48ff_855c_e745490e3112.slice/crio-192b1338c86a9fdc473fe63b124d2496e3825425d464db6f9a3c07fb08943664 WatchSource:0}: Error finding container 192b1338c86a9fdc473fe63b124d2496e3825425d464db6f9a3c07fb08943664: Status 404 returned error can't find the container with id 192b1338c86a9fdc473fe63b124d2496e3825425d464db6f9a3c07fb08943664
Nov 01 03:47:02.735008 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.734968    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:02.766665 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:02.766628    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2" event={"ID":"a8c56eb0-d56d-48ff-855c-e745490e3112","Type":"ContainerStarted","Data":"192b1338c86a9fdc473fe63b124d2496e3825425d464db6f9a3c07fb08943664"}
Nov 01 03:47:03.212182 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:03.212139    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:04.353782 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.353752    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:04.421050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.421019    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"]
Nov 01 03:47:04.425728 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.425709    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.480644 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.480612    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"]
Nov 01 03:47:04.507676 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.507637    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50148341-de5c-44cc-bb4f-a843515103c3-tls-certs\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.507860 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.507684    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50148341-de5c-44cc-bb4f-a843515103c3-tmp\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.507860 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.507714    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p2f6\" (UniqueName: \"kubernetes.io/projected/50148341-de5c-44cc-bb4f-a843515103c3-kube-api-access-8p2f6\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.528650 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.528619    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 01 03:47:04.528650 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.528638    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 01 03:47:04.528899 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.528885    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 01 03:47:04.528943 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.528888    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 01 03:47:04.530121 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.530107    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f88v8\""
Nov 01 03:47:04.606962 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.606865    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:04.609052 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.609031    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50148341-de5c-44cc-bb4f-a843515103c3-tls-certs\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.609146 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.609060    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50148341-de5c-44cc-bb4f-a843515103c3-tmp\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.609146 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.609080    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p2f6\" (UniqueName: \"kubernetes.io/projected/50148341-de5c-44cc-bb4f-a843515103c3-kube-api-access-8p2f6\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.611361 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.611338    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50148341-de5c-44cc-bb4f-a843515103c3-tmp\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.611504 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.611482    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50148341-de5c-44cc-bb4f-a843515103c3-tls-certs\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.671388 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.671351    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p2f6\" (UniqueName: \"kubernetes.io/projected/50148341-de5c-44cc-bb4f-a843515103c3-kube-api-access-8p2f6\") pod \"kube-auth-proxy-5f668977d-rxr8s\" (UID: \"50148341-de5c-44cc-bb4f-a843515103c3\") " pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:04.737323 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:04.737281    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"
Nov 01 03:47:05.027331 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:05.027249    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:05.115790 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:05.115759    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f668977d-rxr8s"]
Nov 01 03:47:05.119472 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:47:05.119442    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50148341_de5c_44cc_bb4f_a843515103c3.slice/crio-dd5bb4017cfd1d02d6e9bc7076cd7fc55f297a471cd8c72a440dc27d48a68de9 WatchSource:0}: Error finding container dd5bb4017cfd1d02d6e9bc7076cd7fc55f297a471cd8c72a440dc27d48a68de9: Status 404 returned error can't find the container with id dd5bb4017cfd1d02d6e9bc7076cd7fc55f297a471cd8c72a440dc27d48a68de9
Nov 01 03:47:05.232423 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:05.232392    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:05.535722 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:05.535688    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:05.783884 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:05.783849    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s" event={"ID":"50148341-de5c-44cc-bb4f-a843515103c3","Type":"ContainerStarted","Data":"dd5bb4017cfd1d02d6e9bc7076cd7fc55f297a471cd8c72a440dc27d48a68de9"}
Nov 01 03:47:06.441737 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:06.441698    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:06.683722 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:06.683685    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:06.922381 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:06.922337    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:07.132858 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:07.132798    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:08.090741 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:08.090706    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:08.343327 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:08.343205    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:08.754104 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:08.754067    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:47:09.401028 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.400990    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"]
Nov 01 03:47:09.406041 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.406011    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:09.464770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.464728    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46bfd00e-97e8-4058-b808-418b76b6dc3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-frcz5\" (UID: \"46bfd00e-97e8-4058-b808-418b76b6dc3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:09.464950 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.464777    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqc5\" (UniqueName: \"kubernetes.io/projected/46bfd00e-97e8-4058-b808-418b76b6dc3b-kube-api-access-2xqc5\") pod \"kuadrant-operator-controller-manager-678d87766f-frcz5\" (UID: \"46bfd00e-97e8-4058-b808-418b76b6dc3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:09.511462 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.511428    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"]
Nov 01 03:47:09.566137 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.566098    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46bfd00e-97e8-4058-b808-418b76b6dc3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-frcz5\" (UID: \"46bfd00e-97e8-4058-b808-418b76b6dc3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:09.566309 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.566200    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqc5\" (UniqueName: \"kubernetes.io/projected/46bfd00e-97e8-4058-b808-418b76b6dc3b-kube-api-access-2xqc5\") pod \"kuadrant-operator-controller-manager-678d87766f-frcz5\" (UID: \"46bfd00e-97e8-4058-b808-418b76b6dc3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:09.566514 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.566490    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46bfd00e-97e8-4058-b808-418b76b6dc3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-frcz5\" (UID: \"46bfd00e-97e8-4058-b808-418b76b6dc3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:09.640759 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.640722    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqc5\" (UniqueName: \"kubernetes.io/projected/46bfd00e-97e8-4058-b808-418b76b6dc3b-kube-api-access-2xqc5\") pod \"kuadrant-operator-controller-manager-678d87766f-frcz5\" (UID: \"46bfd00e-97e8-4058-b808-418b76b6dc3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:09.712348 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.712269    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:09.724442 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.724412    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:09.752055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.752024    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-9bqsl"
Nov 01 03:47:09.812262 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.812209    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2" event={"ID":"a8c56eb0-d56d-48ff-855c-e745490e3112","Type":"ContainerStarted","Data":"45f947723157b169b566452b1714bbf5249862fbdf3fbee43fc7e573b9d83742"}
Nov 01 03:47:09.813786 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.813758    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s" event={"ID":"50148341-de5c-44cc-bb4f-a843515103c3","Type":"ContainerStarted","Data":"9a7b79832808366f0829e9d9fbd4756221a2f7a02955c946af6372f357e150e0"}
Nov 01 03:47:09.963709 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:09.963609    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:10.023738 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:10.023681    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f668977d-rxr8s" podStartSLOduration=1.5776066800000001 podStartE2EDuration="6.023662937s" totalImagesPullingTime="4.446056257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:47:10.022754782 +0000 UTC m=+250.782482577" watchObservedRunningTime="2026-11-01 03:47:10.023662937 +0000 UTC m=+250.783390731"
Nov 01 03:47:10.143757 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:10.143708    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-sbxm2" podStartSLOduration=2.261544312 podStartE2EDuration="9.143694164s" totalImagesPullingTime="6.882149852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:47:10.142291311 +0000 UTC m=+250.902019108" watchObservedRunningTime="2026-11-01 03:47:10.143694164 +0000 UTC m=+250.903421993"
Nov 01 03:47:10.158579 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:10.158544    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"]
Nov 01 03:47:10.161920 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:47:10.161880    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46bfd00e_97e8_4058_b808_418b76b6dc3b.slice/crio-296e56860d7e6aaee3256c56461cb3692e7af0e98bbcfd28420d6a22277f9619 WatchSource:0}: Error finding container 296e56860d7e6aaee3256c56461cb3692e7af0e98bbcfd28420d6a22277f9619: Status 404 returned error can't find the container with id 296e56860d7e6aaee3256c56461cb3692e7af0e98bbcfd28420d6a22277f9619
Nov 01 03:47:10.821222 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:10.821153    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5" event={"ID":"46bfd00e-97e8-4058-b808-418b76b6dc3b","Type":"ContainerStarted","Data":"4c1943cef892b5fc4b1a5f77b251e9eec09a0bf6286178456307084853ea9a05"}
Nov 01 03:47:10.821702 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:10.821234    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5" event={"ID":"46bfd00e-97e8-4058-b808-418b76b6dc3b","Type":"ContainerStarted","Data":"296e56860d7e6aaee3256c56461cb3692e7af0e98bbcfd28420d6a22277f9619"}
Nov 01 03:47:10.821702 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:10.821612    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:10.946053 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:10.945999    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5" podStartSLOduration=1.945984004 podStartE2EDuration="1.945984004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:47:10.944726864 +0000 UTC m=+251.704454659" watchObservedRunningTime="2026-11-01 03:47:10.945984004 +0000 UTC m=+251.705711806"
Nov 01 03:47:11.815280 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:11.815242    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:12.417788 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:12.417754    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:12.643992 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:12.643960    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:13.378103 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:13.378068    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:13.578704 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:13.578659    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:14.283318 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:47:14.283285    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:47:14.832783 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:14.832704    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:15.051816 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:15.051766    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:15.803957 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:15.803908    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:15.996661 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:15.996630    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:18.239084 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:18.239041    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:18.440205 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:18.440119    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:21.829943 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:21.829907    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-frcz5"
Nov 01 03:47:22.056339 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.056304    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"]
Nov 01 03:47:22.056734 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.056701    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr" podUID="f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e" containerName="manager" containerID="cri-o://45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c" gracePeriod=10
Nov 01 03:47:22.304817 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.304793    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:47:22.367427 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.367395    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-extensions-socket-volume\") pod \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\" (UID: \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\") "
Nov 01 03:47:22.367618 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.367438    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-kube-api-access-7kdzh\" (UniqueName: \"kubernetes.io/projected/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-kube-api-access-7kdzh\") pod \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\" (UID: \"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e\") "
Nov 01 03:47:22.367806 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.367780    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-extensions-socket-volume" pod "f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e" (UID: "f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 03:47:22.369716 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.369696    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-kube-api-access-7kdzh" pod "f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e" (UID: "f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e"). InnerVolumeSpecName "kube-api-access-7kdzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:47:22.468853 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.468772    5529 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-extensions-socket-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:47:22.468853 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.468801    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kdzh\" (UniqueName: \"kubernetes.io/projected/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e-kube-api-access-7kdzh\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:47:22.883169 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.883134    5529 generic.go:356] "Generic (PLEG): container finished" podID="f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e" containerID="45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c" exitCode=0
Nov 01 03:47:22.883577 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.883198    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"
Nov 01 03:47:22.883577 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.883223    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr" event={"ID":"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e","Type":"ContainerDied","Data":"45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c"}
Nov 01 03:47:22.883577 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.883282    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr" event={"ID":"f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e","Type":"ContainerDied","Data":"f4eba874d730a099110e5fd525904426c66c8fa1d75ab5af3db604caa241afdf"}
Nov 01 03:47:22.883577 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.883303    5529 scope.go:122] "RemoveContainer" containerID="45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c"
Nov 01 03:47:22.892963 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.892944    5529 scope.go:122] "RemoveContainer" containerID="45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c"
Nov 01 03:47:22.893281 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:47:22.893261    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c\": container with ID starting with 45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c not found: ID does not exist" containerID="45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c"
Nov 01 03:47:22.893340 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:22.893292    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c"} err="failed to get container status \"45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c\": rpc error: code = NotFound desc = could not find container \"45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c\": container with ID starting with 45465692df60ab60e404e0a666926e76d0fe94d2d4b228d39f0871eab825d63c not found: ID does not exist"
Nov 01 03:47:23.086297 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:23.086266    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"]
Nov 01 03:47:23.136784 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:23.136711    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pngcr"]
Nov 01 03:47:23.371719 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:23.371683    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e" path="/var/lib/kubelet/pods/f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e/volumes"
Nov 01 03:47:24.994244 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:24.994207    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:25.194682 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:25.194640    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:32.275732 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:32.275695    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:32.473679 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:32.473642    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:34.820605 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:34.820556    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:35.017806 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:35.017775    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:35.423325 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:35.423282    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:35.620747 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:35.620716    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:39.214429 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:39.214333    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:39.419938 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:39.419896    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:41.215063 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:41.215023    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:41.416943 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:41.416911    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:44.283505 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:47:44.283464    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:47:45.666052 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:45.666019    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:45.913969 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:45.913924    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:46.445223 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:46.445182    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:47.822472 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:47.822431    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:48.026659 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:48.026628    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:48.228424 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:48.228372    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:48.425242 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:48.425203    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:48.624313 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:48.624285    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:48.829634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:48.829595    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:56.438759 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:56.438714    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:56.637401 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:56.637363    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:59.409019 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:59.408989    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:47:59.410809 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:59.410789    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:47:59.433074 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:59.433047    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:47:59.636085 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:47:59.636054    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:01.947204 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:01.947150    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:02.145620 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:02.145589    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:02.343616 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:02.343537    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:14.283444 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:48:14.283404    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:48:15.149097 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.149063    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5854896b77-fj9jx"]
Nov 01 03:48:15.149456 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.149444    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e" containerName="manager"
Nov 01 03:48:15.149499 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.149457    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e" containerName="manager"
Nov 01 03:48:15.149534 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.149514    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="f179e4ed-3bb6-4d78-8de0-f9ec6cf65f2e" containerName="manager"
Nov 01 03:48:15.152691 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.152669    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.173317 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.173290    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:15.205691 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.205667    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Nov 01 03:48:15.205811 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.205744    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nsjj5\""
Nov 01 03:48:15.223041 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.223010    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4rs\" (UniqueName: \"kubernetes.io/projected/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-kube-api-access-2b4rs\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.223187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.223068    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-metrics-certs\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.223239 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.223182    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-webhook-cert\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.255920 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.255890    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 01 03:48:15.255920 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.255908    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Nov 01 03:48:15.256118 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.255884    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Nov 01 03:48:15.256118 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.256088    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 01 03:48:15.258058 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.258040    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5854896b77-fj9jx"]
Nov 01 03:48:15.323960 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.323929    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-metrics-certs\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.324394 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.323972    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-webhook-cert\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.324394 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.324021    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4rs\" (UniqueName: \"kubernetes.io/projected/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-kube-api-access-2b4rs\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.326549 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.326520    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-webhook-cert\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.326696 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.326625    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-metrics-certs\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.377744 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.377712    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:15.387573 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.387550    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4rs\" (UniqueName: \"kubernetes.io/projected/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-kube-api-access-2b4rs\") pod \"maas-controller-5854896b77-fj9jx\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") " pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.464739 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.464641    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:15.580676 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.580636    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:15.679426 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.679387    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6686485556-8hwrr"]
Nov 01 03:48:15.683794 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.683772    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.726438 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.726353    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/487a402a-8513-43c4-a5cb-12a007b26860-webhook-cert\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.726587 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.726437    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/487a402a-8513-43c4-a5cb-12a007b26860-metrics-certs\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.726587 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.726490    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kdvq\" (UniqueName: \"kubernetes.io/projected/487a402a-8513-43c4-a5cb-12a007b26860-kube-api-access-4kdvq\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.738680 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.738652    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6686485556-8hwrr"]
Nov 01 03:48:15.827142 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.827100    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kdvq\" (UniqueName: \"kubernetes.io/projected/487a402a-8513-43c4-a5cb-12a007b26860-kube-api-access-4kdvq\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.827359 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.827197    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/487a402a-8513-43c4-a5cb-12a007b26860-webhook-cert\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.827359 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.827268    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/487a402a-8513-43c4-a5cb-12a007b26860-metrics-certs\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.829714 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.829689    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/487a402a-8513-43c4-a5cb-12a007b26860-webhook-cert\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.829817 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.829717    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/487a402a-8513-43c4-a5cb-12a007b26860-metrics-certs\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.867773 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.867745    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5854896b77-fj9jx"]
Nov 01 03:48:15.870782 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:48:15.870747    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ceb8952_dc7a_4881_bf0d_0719e2c7339b.slice/crio-79fe2b2e197424ae1849278550bceba783c1f71a3e9a2e2579dc5183fffd4bb8 WatchSource:0}: Error finding container 79fe2b2e197424ae1849278550bceba783c1f71a3e9a2e2579dc5183fffd4bb8: Status 404 returned error can't find the container with id 79fe2b2e197424ae1849278550bceba783c1f71a3e9a2e2579dc5183fffd4bb8
Nov 01 03:48:15.872121 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.872105    5529 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 03:48:15.889034 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.889011    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kdvq\" (UniqueName: \"kubernetes.io/projected/487a402a-8513-43c4-a5cb-12a007b26860-kube-api-access-4kdvq\") pod \"maas-controller-6686485556-8hwrr\" (UID: \"487a402a-8513-43c4-a5cb-12a007b26860\") " pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:15.996639 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:15.996554    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:16.150068 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:16.150033    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5854896b77-fj9jx" event={"ID":"6ceb8952-dc7a-4881-bf0d-0719e2c7339b","Type":"ContainerStarted","Data":"79fe2b2e197424ae1849278550bceba783c1f71a3e9a2e2579dc5183fffd4bb8"}
Nov 01 03:48:16.371587 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:16.371520    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6686485556-8hwrr"]
Nov 01 03:48:16.374785 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:48:16.374750    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487a402a_8513_43c4_a5cb_12a007b26860.slice/crio-6312b21b19986621f4debfbdbdf4bd6eee746a9f528356fcfd1f4e866d91c454 WatchSource:0}: Error finding container 6312b21b19986621f4debfbdbdf4bd6eee746a9f528356fcfd1f4e866d91c454: Status 404 returned error can't find the container with id 6312b21b19986621f4debfbdbdf4bd6eee746a9f528356fcfd1f4e866d91c454
Nov 01 03:48:17.156856 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:17.156824    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6686485556-8hwrr" event={"ID":"487a402a-8513-43c4-a5cb-12a007b26860","Type":"ContainerStarted","Data":"6312b21b19986621f4debfbdbdf4bd6eee746a9f528356fcfd1f4e866d91c454"}
Nov 01 03:48:23.194712 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:23.194668    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6686485556-8hwrr" event={"ID":"487a402a-8513-43c4-a5cb-12a007b26860","Type":"ContainerStarted","Data":"9a22d07f05dc308a70f1771f3982afd4d9d167c2b06a01f6fad1d9ae3f9036e2"}
Nov 01 03:48:23.195214 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:23.194751    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:23.196220 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:23.196197    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5854896b77-fj9jx" event={"ID":"6ceb8952-dc7a-4881-bf0d-0719e2c7339b","Type":"ContainerStarted","Data":"ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e"}
Nov 01 03:48:23.196319 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:23.196251    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:23.333090 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:23.332999    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-6686485556-8hwrr" podStartSLOduration=1.719693208 podStartE2EDuration="8.332983485s" totalImagesPullingTime="6.613290277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:48:23.331106422 +0000 UTC m=+324.090834216" watchObservedRunningTime="2026-11-01 03:48:23.332983485 +0000 UTC m=+324.092711279"
Nov 01 03:48:23.458009 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:23.457954    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-5854896b77-fj9jx" podStartSLOduration=1.293796312 podStartE2EDuration="8.457938835s" totalImagesPullingTime="7.164142523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:48:23.456280502 +0000 UTC m=+324.216008309" watchObservedRunningTime="2026-11-01 03:48:23.457938835 +0000 UTC m=+324.217666648"
Nov 01 03:48:23.470965 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:23.470932    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:23.674334 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:23.674302    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:26.541756 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:26.541723    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:26.754893 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:26.754863    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:30.293757 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:30.293720    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:30.491631 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:30.491596    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:30.700345 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:30.700314    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:34.203572 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.203541    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:34.203953 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.203615    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:48:34.481822 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.481740    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5854896b77-fj9jx"]
Nov 01 03:48:34.481976 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.481926    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-5854896b77-fj9jx" podUID="6ceb8952-dc7a-4881-bf0d-0719e2c7339b" containerName="manager" containerID="cri-o://ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e" gracePeriod=30
Nov 01 03:48:34.827628 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.827602    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:34.911586 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.911556    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-metrics-certs\") pod \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") "
Nov 01 03:48:34.911766 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.911611    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-webhook-cert\") pod \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") "
Nov 01 03:48:34.911766 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.911653    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-kube-api-access-2b4rs\" (UniqueName: \"kubernetes.io/projected/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-kube-api-access-2b4rs\") pod \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\" (UID: \"6ceb8952-dc7a-4881-bf0d-0719e2c7339b\") "
Nov 01 03:48:34.913882 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.913852    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-metrics-certs" pod "6ceb8952-dc7a-4881-bf0d-0719e2c7339b" (UID: "6ceb8952-dc7a-4881-bf0d-0719e2c7339b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:48:34.913998 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.913898    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-webhook-cert" pod "6ceb8952-dc7a-4881-bf0d-0719e2c7339b" (UID: "6ceb8952-dc7a-4881-bf0d-0719e2c7339b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:48:34.913998 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:34.913966    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-kube-api-access-2b4rs" pod "6ceb8952-dc7a-4881-bf0d-0719e2c7339b" (UID: "6ceb8952-dc7a-4881-bf0d-0719e2c7339b"). InnerVolumeSpecName "kube-api-access-2b4rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:48:35.012805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.012714    5529 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-webhook-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:48:35.012805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.012748    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b4rs\" (UniqueName: \"kubernetes.io/projected/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-kube-api-access-2b4rs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:48:35.012805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.012758    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ceb8952-dc7a-4881-bf0d-0719e2c7339b-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:48:35.256213 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.256148    5529 generic.go:356] "Generic (PLEG): container finished" podID="6ceb8952-dc7a-4881-bf0d-0719e2c7339b" containerID="ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e" exitCode=0
Nov 01 03:48:35.256626 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.256231    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5854896b77-fj9jx"
Nov 01 03:48:35.256626 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.256239    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5854896b77-fj9jx" event={"ID":"6ceb8952-dc7a-4881-bf0d-0719e2c7339b","Type":"ContainerDied","Data":"ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e"}
Nov 01 03:48:35.256626 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.256305    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5854896b77-fj9jx" event={"ID":"6ceb8952-dc7a-4881-bf0d-0719e2c7339b","Type":"ContainerDied","Data":"79fe2b2e197424ae1849278550bceba783c1f71a3e9a2e2579dc5183fffd4bb8"}
Nov 01 03:48:35.256626 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.256336    5529 scope.go:122] "RemoveContainer" containerID="ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e"
Nov 01 03:48:35.265546 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.265525    5529 scope.go:122] "RemoveContainer" containerID="ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e"
Nov 01 03:48:35.265860 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:48:35.265839    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e\": container with ID starting with ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e not found: ID does not exist" containerID="ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e"
Nov 01 03:48:35.265945 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.265869    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e"} err="failed to get container status \"ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e\": rpc error: code = NotFound desc = could not find container \"ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e\": container with ID starting with ec3609105039910ea9af72183fc173225b6a1e27729b5824f552d2e077a4ed0e not found: ID does not exist"
Nov 01 03:48:35.425715 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.425678    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5854896b77-fj9jx"]
Nov 01 03:48:35.476145 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:35.476105    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5854896b77-fj9jx"]
Nov 01 03:48:37.371319 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:37.371290    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ceb8952-dc7a-4881-bf0d-0719e2c7339b" path="/var/lib/kubelet/pods/6ceb8952-dc7a-4881-bf0d-0719e2c7339b/volumes"
Nov 01 03:48:38.544278 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:38.544245    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:38.742286 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:38.742254    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:38.942017 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:38.941983    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:39.144988 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.144952    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:39.352349 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.352269    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:39.398798 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.398767    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-cvk8n"]
Nov 01 03:48:39.399154 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.399130    5529 cpu_manager.go:414] "containerMap: removing container" podUID="6ceb8952-dc7a-4881-bf0d-0719e2c7339b" containerName="manager"
Nov 01 03:48:39.399229 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.399157    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ceb8952-dc7a-4881-bf0d-0719e2c7339b" containerName="manager"
Nov 01 03:48:39.399267 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.399254    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ceb8952-dc7a-4881-bf0d-0719e2c7339b" containerName="manager"
Nov 01 03:48:39.402348 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.402333    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:39.455333 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.455298    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4fq7z\""
Nov 01 03:48:39.455466 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.455350    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Nov 01 03:48:39.456217 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.456196    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-cvk8n"]
Nov 01 03:48:39.509910 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.509875    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"]
Nov 01 03:48:39.513023 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.513006    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:39.553734 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.553702    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d07b79b-0032-4ba2-bb58-cadc2f614a42-cert\") pod \"kserve-controller-manager-776cc66d47-cvk8n\" (UID: \"5d07b79b-0032-4ba2-bb58-cadc2f614a42\") " pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:39.554105 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.553749    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w777z\" (UniqueName: \"kubernetes.io/projected/5d07b79b-0032-4ba2-bb58-cadc2f614a42-kube-api-access-w777z\") pod \"kserve-controller-manager-776cc66d47-cvk8n\" (UID: \"5d07b79b-0032-4ba2-bb58-cadc2f614a42\") " pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:39.556388 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.556365    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:39.566233 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.566200    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-68fql\""
Nov 01 03:48:39.566364 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.566312    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 01 03:48:39.568571 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.568549    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"]
Nov 01 03:48:39.654678 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.654639    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/588519ad-3610-44a3-9334-c5c95ca3b2ab-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-h4phj\" (UID: \"588519ad-3610-44a3-9334-c5c95ca3b2ab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:39.654855 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.654695    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd2q5\" (UniqueName: \"kubernetes.io/projected/588519ad-3610-44a3-9334-c5c95ca3b2ab-kube-api-access-qd2q5\") pod \"llmisvc-controller-manager-869d5dcc5d-h4phj\" (UID: \"588519ad-3610-44a3-9334-c5c95ca3b2ab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:39.654855 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.654808    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d07b79b-0032-4ba2-bb58-cadc2f614a42-cert\") pod \"kserve-controller-manager-776cc66d47-cvk8n\" (UID: \"5d07b79b-0032-4ba2-bb58-cadc2f614a42\") " pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:39.654855 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.654843    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w777z\" (UniqueName: \"kubernetes.io/projected/5d07b79b-0032-4ba2-bb58-cadc2f614a42-kube-api-access-w777z\") pod \"kserve-controller-manager-776cc66d47-cvk8n\" (UID: \"5d07b79b-0032-4ba2-bb58-cadc2f614a42\") " pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:39.657186 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.657149    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d07b79b-0032-4ba2-bb58-cadc2f614a42-cert\") pod \"kserve-controller-manager-776cc66d47-cvk8n\" (UID: \"5d07b79b-0032-4ba2-bb58-cadc2f614a42\") " pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:39.716428 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.713635    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-5md5f"]
Nov 01 03:48:39.718567 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.718533    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:39.723233 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.723209    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w777z\" (UniqueName: \"kubernetes.io/projected/5d07b79b-0032-4ba2-bb58-cadc2f614a42-kube-api-access-w777z\") pod \"kserve-controller-manager-776cc66d47-cvk8n\" (UID: \"5d07b79b-0032-4ba2-bb58-cadc2f614a42\") " pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:39.756046 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.756014    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/588519ad-3610-44a3-9334-c5c95ca3b2ab-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-h4phj\" (UID: \"588519ad-3610-44a3-9334-c5c95ca3b2ab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:39.756214 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.756056    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd2q5\" (UniqueName: \"kubernetes.io/projected/588519ad-3610-44a3-9334-c5c95ca3b2ab-kube-api-access-qd2q5\") pod \"llmisvc-controller-manager-869d5dcc5d-h4phj\" (UID: \"588519ad-3610-44a3-9334-c5c95ca3b2ab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:39.758428 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.758404    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/588519ad-3610-44a3-9334-c5c95ca3b2ab-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-h4phj\" (UID: \"588519ad-3610-44a3-9334-c5c95ca3b2ab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:39.770197 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.770158    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-5md5f"]
Nov 01 03:48:39.772992 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.772969    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hgqkp\""
Nov 01 03:48:39.773099 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.773025    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Nov 01 03:48:39.780538 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.780516    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-v2v7m"]
Nov 01 03:48:39.783850 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.783834    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:39.822374 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.822341    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd2q5\" (UniqueName: \"kubernetes.io/projected/588519ad-3610-44a3-9334-c5c95ca3b2ab-kube-api-access-qd2q5\") pod \"llmisvc-controller-manager-869d5dcc5d-h4phj\" (UID: \"588519ad-3610-44a3-9334-c5c95ca3b2ab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:39.825177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.825132    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:39.843693 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.843659    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-v2v7m"]
Nov 01 03:48:39.857329 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.857297    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c808fe4c-9011-4215-b745-782fc10d9038-tls-certs\") pod \"model-serving-api-75bd89fdfc-5md5f\" (UID: \"c808fe4c-9011-4215-b745-782fc10d9038\") " pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:39.857490 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.857464    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v7l9\" (UniqueName: \"kubernetes.io/projected/c808fe4c-9011-4215-b745-782fc10d9038-kube-api-access-6v7l9\") pod \"model-serving-api-75bd89fdfc-5md5f\" (UID: \"c808fe4c-9011-4215-b745-782fc10d9038\") " pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:39.872147 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.872117    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Nov 01 03:48:39.872343 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.872325    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-h8k45\""
Nov 01 03:48:39.872412 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.872324    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Nov 01 03:48:39.958081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.957994    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvwn\" (UniqueName: \"kubernetes.io/projected/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-kube-api-access-zmvwn\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:39.958081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.958042    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v7l9\" (UniqueName: \"kubernetes.io/projected/c808fe4c-9011-4215-b745-782fc10d9038-kube-api-access-6v7l9\") pod \"model-serving-api-75bd89fdfc-5md5f\" (UID: \"c808fe4c-9011-4215-b745-782fc10d9038\") " pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:39.958295 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.958202    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c808fe4c-9011-4215-b745-782fc10d9038-tls-certs\") pod \"model-serving-api-75bd89fdfc-5md5f\" (UID: \"c808fe4c-9011-4215-b745-782fc10d9038\") " pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:39.958295 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.958237    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-metrics-certs\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:39.958373 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.958355    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-cert\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:39.960696 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:39.960673    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c808fe4c-9011-4215-b745-782fc10d9038-tls-certs\") pod \"model-serving-api-75bd89fdfc-5md5f\" (UID: \"c808fe4c-9011-4215-b745-782fc10d9038\") " pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:40.014511 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.014478    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:40.020322 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.020298    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v7l9\" (UniqueName: \"kubernetes.io/projected/c808fe4c-9011-4215-b745-782fc10d9038-kube-api-access-6v7l9\") pod \"model-serving-api-75bd89fdfc-5md5f\" (UID: \"c808fe4c-9011-4215-b745-782fc10d9038\") " pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:40.038133 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.038106    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:40.059275 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.059242    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvwn\" (UniqueName: \"kubernetes.io/projected/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-kube-api-access-zmvwn\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:40.059422 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.059397    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-metrics-certs\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:40.059464 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.059441    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-cert\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:40.061867 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.061841    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-cert\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:40.061984 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.061881    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-metrics-certs\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:40.121651 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.121620    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvwn\" (UniqueName: \"kubernetes.io/projected/95fe89fb-e7f0-41c7-bd20-5b9ff325b600-kube-api-access-zmvwn\") pod \"odh-model-controller-769875db56-v2v7m\" (UID: \"95fe89fb-e7f0-41c7-bd20-5b9ff325b600\") " pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:40.204437 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.204410    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"]
Nov 01 03:48:40.206174 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:48:40.206129    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod588519ad_3610_44a3_9334_c5c95ca3b2ab.slice/crio-2f9f9321b3c712ce76f845808283f3d23659e840be0e7dfed8217a9d091a5108 WatchSource:0}: Error finding container 2f9f9321b3c712ce76f845808283f3d23659e840be0e7dfed8217a9d091a5108: Status 404 returned error can't find the container with id 2f9f9321b3c712ce76f845808283f3d23659e840be0e7dfed8217a9d091a5108
Nov 01 03:48:40.282521 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.282480    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj" event={"ID":"588519ad-3610-44a3-9334-c5c95ca3b2ab","Type":"ContainerStarted","Data":"2f9f9321b3c712ce76f845808283f3d23659e840be0e7dfed8217a9d091a5108"}
Nov 01 03:48:40.392641 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.392616    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-cvk8n"]
Nov 01 03:48:40.395055 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:48:40.395021    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d07b79b_0032_4ba2_bb58_cadc2f614a42.slice/crio-5b897a0c9246fca4e2860ff862f8279d9afcbeec0bacb879fbbb70807fdd2171 WatchSource:0}: Error finding container 5b897a0c9246fca4e2860ff862f8279d9afcbeec0bacb879fbbb70807fdd2171: Status 404 returned error can't find the container with id 5b897a0c9246fca4e2860ff862f8279d9afcbeec0bacb879fbbb70807fdd2171
Nov 01 03:48:40.395866 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.395842    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:40.423759 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.423726    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-5md5f"]
Nov 01 03:48:40.426895 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:48:40.426858    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc808fe4c_9011_4215_b745_782fc10d9038.slice/crio-043f288dc06963b1e990c677a600c44f8553303c4865e689e0a8bf66719efbea WatchSource:0}: Error finding container 043f288dc06963b1e990c677a600c44f8553303c4865e689e0a8bf66719efbea: Status 404 returned error can't find the container with id 043f288dc06963b1e990c677a600c44f8553303c4865e689e0a8bf66719efbea
Nov 01 03:48:40.774283 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.774247    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-v2v7m"]
Nov 01 03:48:40.777568 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:48:40.777525    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95fe89fb_e7f0_41c7_bd20_5b9ff325b600.slice/crio-a573dd1e0d3911ae36f872864ef5df6a010dd4f7779a6c847669d9f814e694df WatchSource:0}: Error finding container a573dd1e0d3911ae36f872864ef5df6a010dd4f7779a6c847669d9f814e694df: Status 404 returned error can't find the container with id a573dd1e0d3911ae36f872864ef5df6a010dd4f7779a6c847669d9f814e694df
Nov 01 03:48:40.873791 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:40.873747    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:41.289295 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:41.289254    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n" event={"ID":"5d07b79b-0032-4ba2-bb58-cadc2f614a42","Type":"ContainerStarted","Data":"5b897a0c9246fca4e2860ff862f8279d9afcbeec0bacb879fbbb70807fdd2171"}
Nov 01 03:48:41.290482 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:41.290458    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-v2v7m" event={"ID":"95fe89fb-e7f0-41c7-bd20-5b9ff325b600","Type":"ContainerStarted","Data":"a573dd1e0d3911ae36f872864ef5df6a010dd4f7779a6c847669d9f814e694df"}
Nov 01 03:48:41.291642 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:41.291620    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-5md5f" event={"ID":"c808fe4c-9011-4215-b745-782fc10d9038","Type":"ContainerStarted","Data":"043f288dc06963b1e990c677a600c44f8553303c4865e689e0a8bf66719efbea"}
Nov 01 03:48:44.288943 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:48:44.288872    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:48:44.313219 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:44.313155    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-5md5f" event={"ID":"c808fe4c-9011-4215-b745-782fc10d9038","Type":"ContainerStarted","Data":"e56d8df78740e0b4341eaf499515afbf20f7db3e1936ae2e3dc218bd86313886"}
Nov 01 03:48:44.313395 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:44.313292    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:44.432350 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:44.432227    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-5md5f" podStartSLOduration=1.6911170009999998 podStartE2EDuration="5.43220675s" totalImagesPullingTime="3.741089749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:48:44.430244643 +0000 UTC m=+345.189972439" watchObservedRunningTime="2026-11-01 03:48:44.43220675 +0000 UTC m=+345.191934548"
Nov 01 03:48:45.321893 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:45.321808    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj" event={"ID":"588519ad-3610-44a3-9334-c5c95ca3b2ab","Type":"ContainerStarted","Data":"6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d"}
Nov 01 03:48:45.322381 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:45.321901    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:48:45.443266 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:45.443210    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj" podStartSLOduration=1.7521694349999999 podStartE2EDuration="6.443193641s" totalImagesPullingTime="4.691024206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:48:45.441553546 +0000 UTC m=+346.201281341" watchObservedRunningTime="2026-11-01 03:48:45.443193641 +0000 UTC m=+346.202921461"
Nov 01 03:48:46.117919 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:46.117889    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:46.323337 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:46.323300    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:46.519983 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:46.519924    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:46.721676 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:46.721644    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:46.924079 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:46.924048    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:47.164918 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:47.164808    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:47.363937 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:47.363909    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:52.358020 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:52.357933    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-v2v7m" event={"ID":"95fe89fb-e7f0-41c7-bd20-5b9ff325b600","Type":"ContainerStarted","Data":"1d11ce41accf1a57ae6e0c80143d532244f4c7f13f6ca0da2fba88d5fcd48c9f"}
Nov 01 03:48:52.358513 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:52.358040    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:48:52.478856 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:52.478134    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-v2v7m" podStartSLOduration=2.169889816 podStartE2EDuration="13.478114979s" totalImagesPullingTime="11.308225163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:48:52.475825216 +0000 UTC m=+353.235553011" watchObservedRunningTime="2026-11-01 03:48:52.478114979 +0000 UTC m=+353.237842777"
Nov 01 03:48:53.364304 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:53.364264    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n" event={"ID":"5d07b79b-0032-4ba2-bb58-cadc2f614a42","Type":"ContainerStarted","Data":"687a4640f5a1ab0b23436654d93e517e0b5cafa31be2cfeb63a939a3451ffa84"}
Nov 01 03:48:53.545861 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:53.545803    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n" podStartSLOduration=2.21256025 podStartE2EDuration="14.545787098s" totalImagesPullingTime="12.333226848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:48:53.542871243 +0000 UTC m=+354.302599038" watchObservedRunningTime="2026-11-01 03:48:53.545787098 +0000 UTC m=+354.305514936"
Nov 01 03:48:54.370814 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:54.370784    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:48:55.327226 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:55.327191    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-5md5f"
Nov 01 03:48:56.264761 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:56.264694    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:56.468647 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:56.468615    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:58.431999 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:58.431969    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:58.633592 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:58.633558    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:58.864508 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:58.864399    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:48:59.420022 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.419988    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"]
Nov 01 03:48:59.425735 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.425714    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.480716 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.480681    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"]
Nov 01 03:48:59.520848 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.520814    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqv4n\" (UniqueName: \"kubernetes.io/projected/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-kube-api-access-pqv4n\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.521018 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.520864    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-metrics-certs\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.521018 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.520961    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-openshift-service-ca\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.521089 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.521082    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-maas-api-tls\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.528419 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.528400    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qxpmx\""
Nov 01 03:48:59.528419 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.528400    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 01 03:48:59.528419 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.528400    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 01 03:48:59.529129 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.529112    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 01 03:48:59.529183 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.529112    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 01 03:48:59.621459 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.621432    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-maas-api-tls\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.621649 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.621466    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqv4n\" (UniqueName: \"kubernetes.io/projected/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-kube-api-access-pqv4n\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.621649 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.621508    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-metrics-certs\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.621649 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.621561    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-openshift-service-ca\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.622262 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.622243    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-openshift-service-ca\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.623880 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.623860    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-metrics-certs\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.624005 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.623986    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-maas-api-tls\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.683539 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.683468    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqv4n\" (UniqueName: \"kubernetes.io/projected/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-kube-api-access-pqv4n\") pod \"maas-api-7768f9bcc8-bpqhm\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") " pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:48:59.739588 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:48:59.739551    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:49:00.117375 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:00.117300    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"]
Nov 01 03:49:00.120595 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:49:00.120554    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9feb77fe_9e7c_40de_94fd_39cbe315dcb1.slice/crio-42950171cd4ce6fc7db43b15890498ca3f6a8ab01c51fde8060427212b1cf2fc WatchSource:0}: Error finding container 42950171cd4ce6fc7db43b15890498ca3f6a8ab01c51fde8060427212b1cf2fc: Status 404 returned error can't find the container with id 42950171cd4ce6fc7db43b15890498ca3f6a8ab01c51fde8060427212b1cf2fc
Nov 01 03:49:00.400583 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:00.400548    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm" event={"ID":"9feb77fe-9e7c-40de-94fd-39cbe315dcb1","Type":"ContainerStarted","Data":"42950171cd4ce6fc7db43b15890498ca3f6a8ab01c51fde8060427212b1cf2fc"}
Nov 01 03:49:02.613828 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:02.613791    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:49:03.371789 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:03.371761    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-v2v7m"
Nov 01 03:49:07.435979 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:07.435943    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm" event={"ID":"9feb77fe-9e7c-40de-94fd-39cbe315dcb1","Type":"ContainerStarted","Data":"c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a"}
Nov 01 03:49:07.436432 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:07.436197    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:49:07.555628 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:07.555569    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm" podStartSLOduration=1.618802316 podStartE2EDuration="8.55555331s" totalImagesPullingTime="6.936750994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:49:07.553530307 +0000 UTC m=+368.313258102" watchObservedRunningTime="2026-11-01 03:49:07.55555331 +0000 UTC m=+368.315281105"
Nov 01 03:49:13.446326 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:13.446297    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:49:14.030985 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:14.030945    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:49:14.230450 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:14.230410    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:49:14.284483 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:49:14.284403    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:49:16.328159 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:16.328130    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:49:25.140594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.140557    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"]
Nov 01 03:49:25.141047 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.140776    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm" podUID="9feb77fe-9e7c-40de-94fd-39cbe315dcb1" containerName="maas-api" containerID="cri-o://c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a" gracePeriod=30
Nov 01 03:49:25.379996 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.379969    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-cvk8n"
Nov 01 03:49:25.385640 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.385618    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:49:25.528896 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.528801    5529 generic.go:356] "Generic (PLEG): container finished" podID="9feb77fe-9e7c-40de-94fd-39cbe315dcb1" containerID="c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a" exitCode=0
Nov 01 03:49:25.528896 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.528872    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"
Nov 01 03:49:25.528896 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.528883    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm" event={"ID":"9feb77fe-9e7c-40de-94fd-39cbe315dcb1","Type":"ContainerDied","Data":"c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a"}
Nov 01 03:49:25.529256 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.528941    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm" event={"ID":"9feb77fe-9e7c-40de-94fd-39cbe315dcb1","Type":"ContainerDied","Data":"42950171cd4ce6fc7db43b15890498ca3f6a8ab01c51fde8060427212b1cf2fc"}
Nov 01 03:49:25.529256 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.528966    5529 scope.go:122] "RemoveContainer" containerID="c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a"
Nov 01 03:49:25.538059 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.538033    5529 scope.go:122] "RemoveContainer" containerID="c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a"
Nov 01 03:49:25.538390 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:49:25.538364    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a\": container with ID starting with c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a not found: ID does not exist" containerID="c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a"
Nov 01 03:49:25.538482 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.538404    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a"} err="failed to get container status \"c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a\": rpc error: code = NotFound desc = could not find container \"c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a\": container with ID starting with c7d6763533808b8b3cde2e25c2fc2f3c2e141d97fe001d91bbdbe8dd2391101a not found: ID does not exist"
Nov 01 03:49:25.547815 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.547795    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-openshift-service-ca\") pod \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") "
Nov 01 03:49:25.547909 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.547861    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-maas-api-tls\") pod \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") "
Nov 01 03:49:25.547947 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.547921    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-metrics-certs\") pod \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") "
Nov 01 03:49:25.547985 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.547970    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-kube-api-access-pqv4n\" (UniqueName: \"kubernetes.io/projected/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-kube-api-access-pqv4n\") pod \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\" (UID: \"9feb77fe-9e7c-40de-94fd-39cbe315dcb1\") "
Nov 01 03:49:25.548332 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.548152    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-openshift-service-ca" pod "9feb77fe-9e7c-40de-94fd-39cbe315dcb1" (UID: "9feb77fe-9e7c-40de-94fd-39cbe315dcb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 03:49:25.548418 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.548336    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:49:25.550345 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.550315    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-kube-api-access-pqv4n" pod "9feb77fe-9e7c-40de-94fd-39cbe315dcb1" (UID: "9feb77fe-9e7c-40de-94fd-39cbe315dcb1"). InnerVolumeSpecName "kube-api-access-pqv4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:49:25.550459 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.550438    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-metrics-certs" pod "9feb77fe-9e7c-40de-94fd-39cbe315dcb1" (UID: "9feb77fe-9e7c-40de-94fd-39cbe315dcb1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:49:25.550527 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.550460    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-maas-api-tls" pod "9feb77fe-9e7c-40de-94fd-39cbe315dcb1" (UID: "9feb77fe-9e7c-40de-94fd-39cbe315dcb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:49:25.649746 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.649710    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:49:25.649746 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.649740    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:49:25.649746 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.649751    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqv4n\" (UniqueName: \"kubernetes.io/projected/9feb77fe-9e7c-40de-94fd-39cbe315dcb1-kube-api-access-pqv4n\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:49:25.950027 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.949991    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"]
Nov 01 03:49:25.954496 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:25.954466    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7768f9bcc8-bpqhm"]
Nov 01 03:49:27.371586 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:49:27.371550    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9feb77fe-9e7c-40de-94fd-39cbe315dcb1" path="/var/lib/kubelet/pods/9feb77fe-9e7c-40de-94fd-39cbe315dcb1/volumes"
Nov 01 03:49:44.282592 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:49:44.282546    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:50:00.225112 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.225074    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"]
Nov 01 03:50:00.225526 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.225467    5529 cpu_manager.go:414] "containerMap: removing container" podUID="9feb77fe-9e7c-40de-94fd-39cbe315dcb1" containerName="maas-api"
Nov 01 03:50:00.225526 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.225479    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9feb77fe-9e7c-40de-94fd-39cbe315dcb1" containerName="maas-api"
Nov 01 03:50:00.225602 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.225565    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="9feb77fe-9e7c-40de-94fd-39cbe315dcb1" containerName="maas-api"
Nov 01 03:50:00.230843 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.230826    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:00.283675 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.283647    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"]
Nov 01 03:50:00.352534 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.352498    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrc7n\" (UniqueName: \"kubernetes.io/projected/01df910f-c412-4b66-a145-167a59925320-kube-api-access-hrc7n\") pod \"llmisvc-controller-manager-6466c554d8-ccqmz\" (UID: \"01df910f-c412-4b66-a145-167a59925320\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:00.352727 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.352549    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01df910f-c412-4b66-a145-167a59925320-cert\") pod \"llmisvc-controller-manager-6466c554d8-ccqmz\" (UID: \"01df910f-c412-4b66-a145-167a59925320\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:00.453327 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.453290    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrc7n\" (UniqueName: \"kubernetes.io/projected/01df910f-c412-4b66-a145-167a59925320-kube-api-access-hrc7n\") pod \"llmisvc-controller-manager-6466c554d8-ccqmz\" (UID: \"01df910f-c412-4b66-a145-167a59925320\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:00.453498 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.453344    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01df910f-c412-4b66-a145-167a59925320-cert\") pod \"llmisvc-controller-manager-6466c554d8-ccqmz\" (UID: \"01df910f-c412-4b66-a145-167a59925320\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:00.455742 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.455718    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01df910f-c412-4b66-a145-167a59925320-cert\") pod \"llmisvc-controller-manager-6466c554d8-ccqmz\" (UID: \"01df910f-c412-4b66-a145-167a59925320\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:00.515809 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.515737    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrc7n\" (UniqueName: \"kubernetes.io/projected/01df910f-c412-4b66-a145-167a59925320-kube-api-access-hrc7n\") pod \"llmisvc-controller-manager-6466c554d8-ccqmz\" (UID: \"01df910f-c412-4b66-a145-167a59925320\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:00.544439 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.544403    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:00.918596 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:00.918555    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"]
Nov 01 03:50:00.921750 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:50:00.921722    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01df910f_c412_4b66_a145_167a59925320.slice/crio-91acccaa6b1a480e178504ffbdc42b6512e4b5d333e36bd012c0e41f9c6d94c0 WatchSource:0}: Error finding container 91acccaa6b1a480e178504ffbdc42b6512e4b5d333e36bd012c0e41f9c6d94c0: Status 404 returned error can't find the container with id 91acccaa6b1a480e178504ffbdc42b6512e4b5d333e36bd012c0e41f9c6d94c0
Nov 01 03:50:01.709891 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:01.709851    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz" event={"ID":"01df910f-c412-4b66-a145-167a59925320","Type":"ContainerStarted","Data":"91acccaa6b1a480e178504ffbdc42b6512e4b5d333e36bd012c0e41f9c6d94c0"}
Nov 01 03:50:02.717158 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:02.717120    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz" event={"ID":"01df910f-c412-4b66-a145-167a59925320","Type":"ContainerStarted","Data":"39568b834599dca60c0f1580d387a5b7e2050775c2bc295ce0d38b25b040a098"}
Nov 01 03:50:02.717558 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:02.717208    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:02.835507 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:02.835448    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz" podStartSLOduration=1.9162266159999999 podStartE2EDuration="2.83543307s" totalImagesPullingTime="919.206454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:50:02.833974372 +0000 UTC m=+423.593702166" watchObservedRunningTime="2026-11-01 03:50:02.83543307 +0000 UTC m=+423.595160874"
Nov 01 03:50:02.971579 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:02.971500    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:50:14.284203 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:50:14.284145    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:50:33.724393 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:33.724359    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-ccqmz"
Nov 01 03:50:33.871813 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:33.871771    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"]
Nov 01 03:50:33.872043 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:33.872006    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj" podUID="588519ad-3610-44a3-9334-c5c95ca3b2ab" containerName="manager" containerID="cri-o://6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d" gracePeriod=30
Nov 01 03:50:34.112370 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.112346    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:50:34.153504 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.153469    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/588519ad-3610-44a3-9334-c5c95ca3b2ab-kube-api-access-qd2q5\" (UniqueName: \"kubernetes.io/projected/588519ad-3610-44a3-9334-c5c95ca3b2ab-kube-api-access-qd2q5\") pod \"588519ad-3610-44a3-9334-c5c95ca3b2ab\" (UID: \"588519ad-3610-44a3-9334-c5c95ca3b2ab\") "
Nov 01 03:50:34.153681 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.153528    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/588519ad-3610-44a3-9334-c5c95ca3b2ab-cert\" (UniqueName: \"kubernetes.io/secret/588519ad-3610-44a3-9334-c5c95ca3b2ab-cert\") pod \"588519ad-3610-44a3-9334-c5c95ca3b2ab\" (UID: \"588519ad-3610-44a3-9334-c5c95ca3b2ab\") "
Nov 01 03:50:34.155554 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.155527    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/588519ad-3610-44a3-9334-c5c95ca3b2ab-kube-api-access-qd2q5" pod "588519ad-3610-44a3-9334-c5c95ca3b2ab" (UID: "588519ad-3610-44a3-9334-c5c95ca3b2ab"). InnerVolumeSpecName "kube-api-access-qd2q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:50:34.155668 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.155545    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/588519ad-3610-44a3-9334-c5c95ca3b2ab-cert" pod "588519ad-3610-44a3-9334-c5c95ca3b2ab" (UID: "588519ad-3610-44a3-9334-c5c95ca3b2ab"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:50:34.255215 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.255117    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd2q5\" (UniqueName: \"kubernetes.io/projected/588519ad-3610-44a3-9334-c5c95ca3b2ab-kube-api-access-qd2q5\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:50:34.255215 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.255147    5529 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/588519ad-3610-44a3-9334-c5c95ca3b2ab-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:50:34.888595 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.888565    5529 generic.go:356] "Generic (PLEG): container finished" podID="588519ad-3610-44a3-9334-c5c95ca3b2ab" containerID="6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d" exitCode=0
Nov 01 03:50:34.889006 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.888618    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"
Nov 01 03:50:34.889006 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.888652    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj" event={"ID":"588519ad-3610-44a3-9334-c5c95ca3b2ab","Type":"ContainerDied","Data":"6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d"}
Nov 01 03:50:34.889006 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.888711    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj" event={"ID":"588519ad-3610-44a3-9334-c5c95ca3b2ab","Type":"ContainerDied","Data":"2f9f9321b3c712ce76f845808283f3d23659e840be0e7dfed8217a9d091a5108"}
Nov 01 03:50:34.889006 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.888739    5529 scope.go:122] "RemoveContainer" containerID="6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d"
Nov 01 03:50:34.898269 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.898242    5529 scope.go:122] "RemoveContainer" containerID="6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d"
Nov 01 03:50:34.898593 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:50:34.898566    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d\": container with ID starting with 6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d not found: ID does not exist" containerID="6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d"
Nov 01 03:50:34.898650 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.898603    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d"} err="failed to get container status \"6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d\": rpc error: code = NotFound desc = could not find container \"6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d\": container with ID starting with 6a2181dfacd352bd0ba772d11fdfd818dbbe3bdb54bd57be869bc977acfc4a5d not found: ID does not exist"
Nov 01 03:50:34.928074 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:34.928041    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:50:35.055118 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:35.055087    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"]
Nov 01 03:50:35.104777 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:35.104742    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-h4phj"]
Nov 01 03:50:35.180470 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:35.180394    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:50:35.371216 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:35.371184    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="588519ad-3610-44a3-9334-c5c95ca3b2ab" path="/var/lib/kubelet/pods/588519ad-3610-44a3-9334-c5c95ca3b2ab/volumes"
Nov 01 03:50:42.422390 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:42.422303    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:50:42.619238 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:42.619189    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:50:44.284057 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:50:44.284013    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:50:53.991101 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:53.991067    5529 generic.go:356] "Generic (PLEG): container finished" podID="487a402a-8513-43c4-a5cb-12a007b26860" containerID="9a22d07f05dc308a70f1771f3982afd4d9d167c2b06a01f6fad1d9ae3f9036e2" exitCode=1
Nov 01 03:50:53.991500 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:53.991138    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6686485556-8hwrr" event={"ID":"487a402a-8513-43c4-a5cb-12a007b26860","Type":"ContainerDied","Data":"9a22d07f05dc308a70f1771f3982afd4d9d167c2b06a01f6fad1d9ae3f9036e2"}
Nov 01 03:50:53.991556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:53.991512    5529 scope.go:122] "RemoveContainer" containerID="9a22d07f05dc308a70f1771f3982afd4d9d167c2b06a01f6fad1d9ae3f9036e2"
Nov 01 03:50:54.202187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:54.202091    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:50:55.996990 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:55.996947    5529 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:50:56.003211 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:56.003157    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6686485556-8hwrr" event={"ID":"487a402a-8513-43c4-a5cb-12a007b26860","Type":"ContainerStarted","Data":"2c8e572f1f1e7336e80af4367e47b152d22a59033c402455f5591cd9b7f83c25"}
Nov 01 03:50:56.003369 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:50:56.003282    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:51:03.314727 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:03.314678    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:05.121585 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:05.121547    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:05.592530 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:05.592487    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:06.756953 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:06.756915    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:06.962447 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:06.962412    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:07.011336 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:07.011258    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6686485556-8hwrr"
Nov 01 03:51:10.309728 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:10.309690    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:14.287973 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:51:14.287937    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:51:16.153545 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:16.153507    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:21.529025 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:21.528991    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:25.031437 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:25.031373    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:27.983223 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:27.983150    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:31.461111 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:31.461079    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:35.555421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:35.555386    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:36.980906 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:36.980857    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"]
Nov 01 03:51:36.981450 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:36.981304    5529 cpu_manager.go:414] "containerMap: removing container" podUID="588519ad-3610-44a3-9334-c5c95ca3b2ab" containerName="manager"
Nov 01 03:51:36.981450 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:36.981317    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="588519ad-3610-44a3-9334-c5c95ca3b2ab" containerName="manager"
Nov 01 03:51:36.981450 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:36.981371    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="588519ad-3610-44a3-9334-c5c95ca3b2ab" containerName="manager"
Nov 01 03:51:36.984605 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:36.984588    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.037374 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.037342    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qr8p5\""
Nov 01 03:51:37.087663 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.087628    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 01 03:51:37.092228 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.092190    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"]
Nov 01 03:51:37.125583 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.125539    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.125583 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.125585    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q4pd\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-kube-api-access-6q4pd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.125805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.125611    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226ba30c-9da4-4067-ba55-0a030c13a7d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.125805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.125745    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.125805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.125776    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.125935 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.125813    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.125935 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.125890    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.126036 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.125956    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.126091 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.126050    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227375 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227342    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227375 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227376    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227639 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227404    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227639 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227530    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227639 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227635    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227808 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227679    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227808 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227761    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227906 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227802    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227906 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227804    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4pd\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-kube-api-access-6q4pd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227906 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227763    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.227906 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227866    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226ba30c-9da4-4067-ba55-0a030c13a7d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.228091 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.227970    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.228091 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.228033    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.228415 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.228398    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226ba30c-9da4-4067-ba55-0a030c13a7d4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.229816 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.229788    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.230083 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.230060    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.289497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.289416    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4pd\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-kube-api-access-6q4pd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.290010 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.289985    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-cxmt4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.296834 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.296809    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:37.742654 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:37.742554    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"]
Nov 01 03:51:37.745118 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:51:37.745086    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226ba30c_9da4_4067_ba55_0a030c13a7d4.slice/crio-71378b8b44a20ae93a683d32675c54b6bedd80d5c6407aa11b1bd1c02adbc5d8 WatchSource:0}: Error finding container 71378b8b44a20ae93a683d32675c54b6bedd80d5c6407aa11b1bd1c02adbc5d8: Status 404 returned error can't find the container with id 71378b8b44a20ae93a683d32675c54b6bedd80d5c6407aa11b1bd1c02adbc5d8
Nov 01 03:51:38.224651 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:38.224612    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" event={"ID":"226ba30c-9da4-4067-ba55-0a030c13a7d4","Type":"ContainerStarted","Data":"71378b8b44a20ae93a683d32675c54b6bedd80d5c6407aa11b1bd1c02adbc5d8"}
Nov 01 03:51:38.226240 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:38.226217    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:42.185090 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:42.185059    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:51:44.283771 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:51:44.283730    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:51:52.313222 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:52.313180    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:51:52.313643 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:52.313260    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:51:52.313643 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:52.313290    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:51:53.309322 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:53.309291    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" event={"ID":"226ba30c-9da4-4067-ba55-0a030c13a7d4","Type":"ContainerStarted","Data":"c23580dc4e366e7ac2c2c56263627ef8a95a23251058c8a9b5bfc01f8a572bdd"}
Nov 01 03:51:53.487301 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:53.487243    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podStartSLOduration=2.92251932 podStartE2EDuration="17.487228184s" totalImagesPullingTime="14.564708864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:51:53.486859701 +0000 UTC m=+534.246587495" watchObservedRunningTime="2026-11-01 03:51:53.487228184 +0000 UTC m=+534.246955978"
Nov 01 03:51:54.297931 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:54.297893    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:51:54.299318 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:54.299290    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-cxmt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 01 03:51:54.299399 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:54.299346    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 01 03:51:55.297402 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:55.297363    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-cxmt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 01 03:51:55.297814 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:55.297434    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 01 03:51:56.297440 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:56.297397    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-cxmt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 01 03:51:56.297881 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:56.297461    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 01 03:51:57.297915 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:57.297882    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-cxmt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 01 03:51:57.298416 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:57.297934    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 01 03:51:58.297542 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:58.297507    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-cxmt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 01 03:51:58.297740 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:58.297566    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 01 03:51:59.297654 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:59.297616    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-cxmt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Nov 01 03:51:59.298132 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:51:59.297679    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Nov 01 03:52:00.661285 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:00.661251    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:52:00.661958 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:00.661804    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:52:00.663173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:00.663138    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 03:52:03.657247 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:03.657191    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:11.375605 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:11.375507    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:11.586147 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:11.586107    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:12.889103 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:12.889036    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:13.100190 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:13.100127    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:14.284327 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:52:14.284295    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:52:41.075320 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:41.075261    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:41.361330 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:41.361246    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:41.592436 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:41.592386    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:41.940450 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:41.940417    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:42.149547 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:42.149514    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:42.360474 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:42.360381    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:42.559014 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:42.558981    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:42.756681 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:42.756644    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:42.967055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:42.967019    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:44.251757 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:44.251719    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:44.285039 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:52:44.285000    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:52:44.456097 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:44.456053    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:45.491635 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:45.491591    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:45.745661 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:45.745546    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:46.323438 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:46.323402    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:46.531035 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:46.530999    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:48.195922 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:48.195884    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:48.403899 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:48.403864    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:48.613143 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:48.613001    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:48.892027 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:48.891966    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:49.101420 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:49.101356    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:49.309110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:49.309029    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:49.519636 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:49.519588    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:51.852923 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:51.852887    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:52.054602 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:52.054569    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:52.253627 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:52.253593    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:52.469408 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:52.469371    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:53.492652 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.492612    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:53.694025 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.693991    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:53.845120 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.845044    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"]
Nov 01 03:52:53.852945 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.852917    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:53.866719 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.866685    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7j9t\" (UniqueName: \"kubernetes.io/projected/4bdf3481-9844-4af1-92f2-da761a532ccf-kube-api-access-c7j9t\") pod \"payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x\" (UID: \"4bdf3481-9844-4af1-92f2-da761a532ccf\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:53.866832 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.866734    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bdf3481-9844-4af1-92f2-da761a532ccf-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x\" (UID: \"4bdf3481-9844-4af1-92f2-da761a532ccf\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:53.925531 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.925496    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-f50c3be9\""
Nov 01 03:52:53.967766 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.967735    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7j9t\" (UniqueName: \"kubernetes.io/projected/4bdf3481-9844-4af1-92f2-da761a532ccf-kube-api-access-c7j9t\") pod \"payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x\" (UID: \"4bdf3481-9844-4af1-92f2-da761a532ccf\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:53.967969 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.967780    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bdf3481-9844-4af1-92f2-da761a532ccf-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x\" (UID: \"4bdf3481-9844-4af1-92f2-da761a532ccf\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:53.968496 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.968477    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bdf3481-9844-4af1-92f2-da761a532ccf-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x\" (UID: \"4bdf3481-9844-4af1-92f2-da761a532ccf\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:53.976233 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.976202    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-f50c3be9-dockercfg-qrsds\""
Nov 01 03:52:53.978048 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:53.978024    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"]
Nov 01 03:52:54.028391 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.028355    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"]
Nov 01 03:52:54.030051 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.030017    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7j9t\" (UniqueName: \"kubernetes.io/projected/4bdf3481-9844-4af1-92f2-da761a532ccf-kube-api-access-c7j9t\") pod \"payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x\" (UID: \"4bdf3481-9844-4af1-92f2-da761a532ccf\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:54.032050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.032026    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:54.061592 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.061561    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"]
Nov 01 03:52:54.068833 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.068802    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a71d94e-fb91-4826-a13e-9a797a03380c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6\" (UID: \"8a71d94e-fb91-4826-a13e-9a797a03380c\") " pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:54.069015 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.068850    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qkc\" (UniqueName: \"kubernetes.io/projected/8a71d94e-fb91-4826-a13e-9a797a03380c-kube-api-access-x4qkc\") pod \"payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6\" (UID: \"8a71d94e-fb91-4826-a13e-9a797a03380c\") " pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:54.166059 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.166024    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:54.170480 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.170453    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a71d94e-fb91-4826-a13e-9a797a03380c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6\" (UID: \"8a71d94e-fb91-4826-a13e-9a797a03380c\") " pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:54.170568 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.170524    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qkc\" (UniqueName: \"kubernetes.io/projected/8a71d94e-fb91-4826-a13e-9a797a03380c-kube-api-access-x4qkc\") pod \"payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6\" (UID: \"8a71d94e-fb91-4826-a13e-9a797a03380c\") " pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:54.171430 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.171394    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a71d94e-fb91-4826-a13e-9a797a03380c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6\" (UID: \"8a71d94e-fb91-4826-a13e-9a797a03380c\") " pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:54.233751 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.233719    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qkc\" (UniqueName: \"kubernetes.io/projected/8a71d94e-fb91-4826-a13e-9a797a03380c-kube-api-access-x4qkc\") pod \"payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6\" (UID: \"8a71d94e-fb91-4826-a13e-9a797a03380c\") " pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:54.351360 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.351310    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:54.547977 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.547952    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"]
Nov 01 03:52:54.550249 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:52:54.550220    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdf3481_9844_4af1_92f2_da761a532ccf.slice/crio-3287a8dd660817a70510e72ec47061ba23259acace2f6b44d3bd96f7f14475d3 WatchSource:0}: Error finding container 3287a8dd660817a70510e72ec47061ba23259acace2f6b44d3bd96f7f14475d3: Status 404 returned error can't find the container with id 3287a8dd660817a70510e72ec47061ba23259acace2f6b44d3bd96f7f14475d3
Nov 01 03:52:54.667484 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.667442    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x" event={"ID":"4bdf3481-9844-4af1-92f2-da761a532ccf","Type":"ContainerStarted","Data":"3287a8dd660817a70510e72ec47061ba23259acace2f6b44d3bd96f7f14475d3"}
Nov 01 03:52:54.728027 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:54.727987    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"]
Nov 01 03:52:54.730951 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:52:54.730923    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a71d94e_fb91_4826_a13e_9a797a03380c.slice/crio-5dc533c3a32dd11ad818adccf7140d2ece23e7e8dcb7e9dc0891fd1b8b2fcfb6 WatchSource:0}: Error finding container 5dc533c3a32dd11ad818adccf7140d2ece23e7e8dcb7e9dc0891fd1b8b2fcfb6: Status 404 returned error can't find the container with id 5dc533c3a32dd11ad818adccf7140d2ece23e7e8dcb7e9dc0891fd1b8b2fcfb6
Nov 01 03:52:55.673564 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:55.673523    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6" event={"ID":"8a71d94e-fb91-4826-a13e-9a797a03380c","Type":"ContainerStarted","Data":"5dc533c3a32dd11ad818adccf7140d2ece23e7e8dcb7e9dc0891fd1b8b2fcfb6"}
Nov 01 03:52:55.942157 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:55.942061    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:56.147124 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:56.146994    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:56.380895 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:56.380796    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:56.581964 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:56.581926    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:57.096849 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.096785    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:57.290954 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.290915    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:57.391285 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.391241    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"]
Nov 01 03:52:57.408389 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.408361    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.449930 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.449887    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"]
Nov 01 03:52:57.488548 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.488514    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:57.497402 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.497375    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3145c214-serving-cert\""
Nov 01 03:52:57.497557 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.497442    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 01 03:52:57.497557 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.497484    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 01 03:52:57.504098 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.504071    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b2f7137-13d5-414c-935b-41ec2e2bbb33-openshift-service-ca\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.504308 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.504281    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fb57\" (UniqueName: \"kubernetes.io/projected/1b2f7137-13d5-414c-935b-41ec2e2bbb33-kube-api-access-2fb57\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.504437 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.504325    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.504437 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.504354    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-metrics-certs\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.511456 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.511435    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qxpmx\""
Nov 01 03:52:57.511643 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.511625    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 01 03:52:57.607584 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.607546    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b2f7137-13d5-414c-935b-41ec2e2bbb33-openshift-service-ca\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.607787 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.607661    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fb57\" (UniqueName: \"kubernetes.io/projected/1b2f7137-13d5-414c-935b-41ec2e2bbb33-kube-api-access-2fb57\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.607787 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.607696    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.607787 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.607731    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-metrics-certs\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.607958 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:52:57.607859    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-serving-cert: secret "maas-api-e2e-ait-3145c214-serving-cert" not found
Nov 01 03:52:57.607958 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:52:57.607934    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls podName:1b2f7137-13d5-414c-935b-41ec2e2bbb33 nodeName:}" failed. No retries permitted until 2026-11-01 03:52:58.107914071 +0000 UTC m=+598.867641860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls") pod "maas-api-e2e-ait-3145c214-dcc546b74-6dkdl" (UID: "1b2f7137-13d5-414c-935b-41ec2e2bbb33") : secret "maas-api-e2e-ait-3145c214-serving-cert" not found
Nov 01 03:52:57.608416 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.608366    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b2f7137-13d5-414c-935b-41ec2e2bbb33-openshift-service-ca\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.610806 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.610782    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-metrics-certs\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.669847 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.669766    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fb57\" (UniqueName: \"kubernetes.io/projected/1b2f7137-13d5-414c-935b-41ec2e2bbb33-kube-api-access-2fb57\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:57.689529 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.689496    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:57.902778 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:57.902739    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:58.113142 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.113055    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:58.115499 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.115480    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls\") pod \"maas-api-e2e-ait-3145c214-dcc546b74-6dkdl\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:58.319074 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.319037    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:58.327912 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.327855    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:58.521962 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.521929    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:52:58.678193 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.678105    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"]
Nov 01 03:52:58.682800 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.682781    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:58.696218 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.696181    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x" event={"ID":"4bdf3481-9844-4af1-92f2-da761a532ccf","Type":"ContainerStarted","Data":"64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826"}
Nov 01 03:52:58.696350 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.696320    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:52:58.697971 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.697945    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6" event={"ID":"8a71d94e-fb91-4826-a13e-9a797a03380c","Type":"ContainerStarted","Data":"f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967"}
Nov 01 03:52:58.698093 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.697993    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:52:58.714026 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.713997    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"]
Nov 01 03:52:58.719030 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.719007    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56effd65-769d-4987-8751-ceae25086516-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx\" (UID: \"56effd65-769d-4987-8751-ceae25086516\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:58.719142 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.719038    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6228\" (UniqueName: \"kubernetes.io/projected/56effd65-769d-4987-8751-ceae25086516-kube-api-access-d6228\") pod \"payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx\" (UID: \"56effd65-769d-4987-8751-ceae25086516\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:58.736148 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.736102    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3145c214\""
Nov 01 03:52:58.737017 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.736982    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"]
Nov 01 03:52:58.737187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.736103    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3145c214-dockercfg-gnklx\""
Nov 01 03:52:58.753553 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:52:58.753520    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2f7137_13d5_414c_935b_41ec2e2bbb33.slice/crio-0b4a98dccca27b241de8a7bc455b7a9e3f92e6f19a5d37e8fb4e3c9168101309 WatchSource:0}: Error finding container 0b4a98dccca27b241de8a7bc455b7a9e3f92e6f19a5d37e8fb4e3c9168101309: Status 404 returned error can't find the container with id 0b4a98dccca27b241de8a7bc455b7a9e3f92e6f19a5d37e8fb4e3c9168101309
Nov 01 03:52:58.819932 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.819894    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56effd65-769d-4987-8751-ceae25086516-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx\" (UID: \"56effd65-769d-4987-8751-ceae25086516\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:58.819932 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.819938    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6228\" (UniqueName: \"kubernetes.io/projected/56effd65-769d-4987-8751-ceae25086516-kube-api-access-d6228\") pod \"payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx\" (UID: \"56effd65-769d-4987-8751-ceae25086516\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:58.821040 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.821012    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56effd65-769d-4987-8751-ceae25086516-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx\" (UID: \"56effd65-769d-4987-8751-ceae25086516\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:58.881715 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.881680    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6228\" (UniqueName: \"kubernetes.io/projected/56effd65-769d-4987-8751-ceae25086516-kube-api-access-d6228\") pod \"payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx\" (UID: \"56effd65-769d-4987-8751-ceae25086516\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:58.918637 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.918551    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x" podStartSLOduration=2.751466299 podStartE2EDuration="5.918533097s" totalImagesPullingTime="3.167066798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:52:58.916233913 +0000 UTC m=+599.675961707" watchObservedRunningTime="2026-11-01 03:52:58.918533097 +0000 UTC m=+599.678260898"
Nov 01 03:52:58.996991 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:58.996903    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:59.032497 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.032429    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6" podStartSLOduration=2.928598424 podStartE2EDuration="6.032412284s" totalImagesPullingTime="3.10381386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:52:59.031781836 +0000 UTC m=+599.791509631" watchObservedRunningTime="2026-11-01 03:52:59.032412284 +0000 UTC m=+599.792140079"
Nov 01 03:52:59.375604 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.375576    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"]
Nov 01 03:52:59.379639 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:52:59.379613    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56effd65_769d_4987_8751_ceae25086516.slice/crio-bd03a7aafa323a70dfef69aa2c6679cc6e206519c72fb3fd3dd3fc92c7bb3a70 WatchSource:0}: Error finding container bd03a7aafa323a70dfef69aa2c6679cc6e206519c72fb3fd3dd3fc92c7bb3a70: Status 404 returned error can't find the container with id bd03a7aafa323a70dfef69aa2c6679cc6e206519c72fb3fd3dd3fc92c7bb3a70
Nov 01 03:52:59.452643 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.452617    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:52:59.454149 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.454129    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:52:59.708193 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.705175    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx" event={"ID":"56effd65-769d-4987-8751-ceae25086516","Type":"ContainerStarted","Data":"35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612"}
Nov 01 03:52:59.708193 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.705241    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx" event={"ID":"56effd65-769d-4987-8751-ceae25086516","Type":"ContainerStarted","Data":"bd03a7aafa323a70dfef69aa2c6679cc6e206519c72fb3fd3dd3fc92c7bb3a70"}
Nov 01 03:52:59.708193 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.705350    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:52:59.708193 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.706962    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl" event={"ID":"1b2f7137-13d5-414c-935b-41ec2e2bbb33","Type":"ContainerStarted","Data":"c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912"}
Nov 01 03:52:59.708193 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.707013    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl" event={"ID":"1b2f7137-13d5-414c-935b-41ec2e2bbb33","Type":"ContainerStarted","Data":"0b4a98dccca27b241de8a7bc455b7a9e3f92e6f19a5d37e8fb4e3c9168101309"}
Nov 01 03:52:59.708193 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.707297    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:52:59.821392 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.821332    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx" podStartSLOduration=1.8213178060000002 podStartE2EDuration="1.821317806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:52:59.820959089 +0000 UTC m=+600.580686884" watchObservedRunningTime="2026-11-01 03:52:59.821317806 +0000 UTC m=+600.581045601"
Nov 01 03:52:59.941307 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:52:59.941208    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl" podStartSLOduration=2.08940327 podStartE2EDuration="2.941190866s" totalImagesPullingTime="851.787596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:52:59.939447218 +0000 UTC m=+600.699175017" watchObservedRunningTime="2026-11-01 03:52:59.941190866 +0000 UTC m=+600.700918661"
Nov 01 03:53:03.003658 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:03.003624    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:03.205967 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:03.205932    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:03.990530 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:03.990497    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:05.068664 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:05.068636    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:05.271675 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:05.271643    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:05.719883 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:05.719856    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:53:07.499487 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.499454    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"]
Nov 01 03:53:07.503564 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.503543    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.606492 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.606459    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-48d2fd87-serving-cert\""
Nov 01 03:53:07.608723 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.608697    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"]
Nov 01 03:53:07.608859 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.608832    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp5f2\" (UniqueName: \"kubernetes.io/projected/2a4de544-1b4b-4d43-85bf-6eb228e431fd-kube-api-access-kp5f2\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.608911 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.608893    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4de544-1b4b-4d43-85bf-6eb228e431fd-openshift-service-ca\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.608952 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.608941    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-metrics-certs\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.608992 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.608977    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.710470 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.710435    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp5f2\" (UniqueName: \"kubernetes.io/projected/2a4de544-1b4b-4d43-85bf-6eb228e431fd-kube-api-access-kp5f2\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.710729 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.710495    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4de544-1b4b-4d43-85bf-6eb228e431fd-openshift-service-ca\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.710729 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.710511    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-metrics-certs\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.710729 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.710529    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.710729 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:53:07.710670    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-serving-cert: secret "maas-api-e2e-ait-48d2fd87-serving-cert" not found
Nov 01 03:53:07.710729 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:53:07.710741    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls podName:2a4de544-1b4b-4d43-85bf-6eb228e431fd nodeName:}" failed. No retries permitted until 2026-11-01 03:53:08.210721229 +0000 UTC m=+608.970449004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls") pod "maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb" (UID: "2a4de544-1b4b-4d43-85bf-6eb228e431fd") : secret "maas-api-e2e-ait-48d2fd87-serving-cert" not found
Nov 01 03:53:07.711314 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.711290    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4de544-1b4b-4d43-85bf-6eb228e431fd-openshift-service-ca\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.713110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.713088    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-metrics-certs\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.751184 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.751082    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:07.773928 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.773896    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp5f2\" (UniqueName: \"kubernetes.io/projected/2a4de544-1b4b-4d43-85bf-6eb228e431fd-kube-api-access-kp5f2\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:07.950476 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:07.950440    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:08.153184 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:08.153109    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:08.214458 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:08.214424    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:08.216827 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:08.216806    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls\") pod \"maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:08.416794 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:08.416708    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:08.796124 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:08.796096    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"]
Nov 01 03:53:08.799050 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:53:08.799017    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4de544_1b4b_4d43_85bf_6eb228e431fd.slice/crio-2d693a9015e99173ccdaa4eec69f11c1751ede453935b3503f2a79ead29478f0 WatchSource:0}: Error finding container 2d693a9015e99173ccdaa4eec69f11c1751ede453935b3503f2a79ead29478f0: Status 404 returned error can't find the container with id 2d693a9015e99173ccdaa4eec69f11c1751ede453935b3503f2a79ead29478f0
Nov 01 03:53:09.710088 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:09.710067    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:53:09.710227 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:09.710137    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:53:09.770053 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:09.770022    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb" event={"ID":"2a4de544-1b4b-4d43-85bf-6eb228e431fd","Type":"ContainerStarted","Data":"2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a"}
Nov 01 03:53:09.770254 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:09.770071    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb" event={"ID":"2a4de544-1b4b-4d43-85bf-6eb228e431fd","Type":"ContainerStarted","Data":"2d693a9015e99173ccdaa4eec69f11c1751ede453935b3503f2a79ead29478f0"}
Nov 01 03:53:09.770254 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:09.770094    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:10.070503 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:10.070411    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb" podStartSLOduration=2.215283291 podStartE2EDuration="3.070397376s" totalImagesPullingTime="855.114085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:53:10.069915172 +0000 UTC m=+610.829642968" watchObservedRunningTime="2026-11-01 03:53:10.070397376 +0000 UTC m=+610.830125171"
Nov 01 03:53:10.716724 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:10.716690    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:53:13.017697 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:13.017653    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:14.283580 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:53:14.283537    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:53:15.780993 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:15.780962    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:53:17.772460 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.772415    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"]
Nov 01 03:53:17.776177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.776142    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:17.880922 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.880887    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-6800c12d-serving-cert\""
Nov 01 03:53:17.883135 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.883112    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"]
Nov 01 03:53:17.926406 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.926375    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a01123-7a15-4a86-9619-1f120b356db3-openshift-service-ca\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:17.926627 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.926421    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-maas-api-tls\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:17.926627 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.926453    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sg2n\" (UniqueName: \"kubernetes.io/projected/93a01123-7a15-4a86-9619-1f120b356db3-kube-api-access-7sg2n\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:17.926754 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.926636    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-metrics-certs\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:17.995151 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:17.995114    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:18.028050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.027957    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a01123-7a15-4a86-9619-1f120b356db3-openshift-service-ca\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.028050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.028018    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-maas-api-tls\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.028307 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.028063    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sg2n\" (UniqueName: \"kubernetes.io/projected/93a01123-7a15-4a86-9619-1f120b356db3-kube-api-access-7sg2n\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.028691 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.028666    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a01123-7a15-4a86-9619-1f120b356db3-openshift-service-ca\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.028985 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.028951    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-metrics-certs\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.030588 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.030551    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-maas-api-tls\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.031401 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.031381    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-metrics-certs\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.090039 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.090007    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sg2n\" (UniqueName: \"kubernetes.io/projected/93a01123-7a15-4a86-9619-1f120b356db3-kube-api-access-7sg2n\") pod \"maas-api-e2e-derive-6800c12d-6cb88c48-svmbb\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.205926 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.205893    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:18.390114 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.390083    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:18.409238 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.409205    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:18.769949 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.769921    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"]
Nov 01 03:53:18.772533 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:53:18.772507    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a01123_7a15_4a86_9619_1f120b356db3.slice/crio-3a950c7eee9adb1f588ea1de70e5c3966af4c514ffbfda9b870c837debddddf4 WatchSource:0}: Error finding container 3a950c7eee9adb1f588ea1de70e5c3966af4c514ffbfda9b870c837debddddf4: Status 404 returned error can't find the container with id 3a950c7eee9adb1f588ea1de70e5c3966af4c514ffbfda9b870c837debddddf4
Nov 01 03:53:18.773928 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.773912    5529 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 03:53:18.822811 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:18.822783    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb" event={"ID":"93a01123-7a15-4a86-9619-1f120b356db3","Type":"ContainerStarted","Data":"3a950c7eee9adb1f588ea1de70e5c3966af4c514ffbfda9b870c837debddddf4"}
Nov 01 03:53:19.830529 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:19.830494    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb" event={"ID":"93a01123-7a15-4a86-9619-1f120b356db3","Type":"ContainerStarted","Data":"e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3"}
Nov 01 03:53:19.830963 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:19.830578    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:19.951358 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:19.951303    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb" podStartSLOduration=2.111473349 podStartE2EDuration="2.951287298s" totalImagesPullingTime="839.813949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:53:19.94969871 +0000 UTC m=+620.709426504" watchObservedRunningTime="2026-11-01 03:53:19.951287298 +0000 UTC m=+620.711015117"
Nov 01 03:53:23.493625 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:23.493586    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:25.841724 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:25.841687    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:53:28.216689 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:28.216656    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:33.584863 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:33.584833    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:38.765569 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:38.765487    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:44.259815 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:44.259779    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:44.283550 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:53:44.283513    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:53:46.168983 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:46.168927    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:46.367964 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:46.367928    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:49.189904 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:49.189872    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:49.720449 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:49.720416    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:51.353102 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:51.353064    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"]
Nov 01 03:53:51.668708 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:51.668671    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:51.873534 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:51.873494    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:53.564395 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:53.564359    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"]
Nov 01 03:53:53.671059 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:53.671026    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"]
Nov 01 03:53:53.960072 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:53.960032    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:54.159708 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:54.159679    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:54.372040 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:54.371961    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:55.469478 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.469443    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"]
Nov 01 03:53:55.470043 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.469640    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl" podUID="1b2f7137-13d5-414c-935b-41ec2e2bbb33" containerName="maas-api" containerID="cri-o://c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912" gracePeriod=30
Nov 01 03:53:55.625395 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.625351    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:55.723569 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.723501    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:53:55.883818 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.883785    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1b2f7137-13d5-414c-935b-41ec2e2bbb33-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b2f7137-13d5-414c-935b-41ec2e2bbb33-openshift-service-ca\") pod \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") "
Nov 01 03:53:55.883818 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.883821    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls\") pod \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") "
Nov 01 03:53:55.884041 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.883873    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-metrics-certs\") pod \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") "
Nov 01 03:53:55.884041 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.883922    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b2f7137-13d5-414c-935b-41ec2e2bbb33-kube-api-access-2fb57\" (UniqueName: \"kubernetes.io/projected/1b2f7137-13d5-414c-935b-41ec2e2bbb33-kube-api-access-2fb57\") pod \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\" (UID: \"1b2f7137-13d5-414c-935b-41ec2e2bbb33\") "
Nov 01 03:53:55.884254 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.884219    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2f7137-13d5-414c-935b-41ec2e2bbb33-openshift-service-ca" pod "1b2f7137-13d5-414c-935b-41ec2e2bbb33" (UID: "1b2f7137-13d5-414c-935b-41ec2e2bbb33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 03:53:55.886050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.886021    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2f7137-13d5-414c-935b-41ec2e2bbb33-kube-api-access-2fb57" pod "1b2f7137-13d5-414c-935b-41ec2e2bbb33" (UID: "1b2f7137-13d5-414c-935b-41ec2e2bbb33"). InnerVolumeSpecName "kube-api-access-2fb57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:53:55.886155 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.886050    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-metrics-certs" pod "1b2f7137-13d5-414c-935b-41ec2e2bbb33" (UID: "1b2f7137-13d5-414c-935b-41ec2e2bbb33"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:53:55.886155 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.886106    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls" pod "1b2f7137-13d5-414c-935b-41ec2e2bbb33" (UID: "1b2f7137-13d5-414c-935b-41ec2e2bbb33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:53:55.980349 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.980260    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:55.985404 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.985379    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fb57\" (UniqueName: \"kubernetes.io/projected/1b2f7137-13d5-414c-935b-41ec2e2bbb33-kube-api-access-2fb57\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:55.985404 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.985402    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b2f7137-13d5-414c-935b-41ec2e2bbb33-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:55.985634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.985413    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:55.985634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:55.985423    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b2f7137-13d5-414c-935b-41ec2e2bbb33-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:56.035060 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.035021    5529 generic.go:356] "Generic (PLEG): container finished" podID="1b2f7137-13d5-414c-935b-41ec2e2bbb33" containerID="c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912" exitCode=0
Nov 01 03:53:56.035250 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.035067    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"
Nov 01 03:53:56.035250 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.035099    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl" event={"ID":"1b2f7137-13d5-414c-935b-41ec2e2bbb33","Type":"ContainerDied","Data":"c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912"}
Nov 01 03:53:56.035250 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.035151    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl" event={"ID":"1b2f7137-13d5-414c-935b-41ec2e2bbb33","Type":"ContainerDied","Data":"0b4a98dccca27b241de8a7bc455b7a9e3f92e6f19a5d37e8fb4e3c9168101309"}
Nov 01 03:53:56.035250 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.035202    5529 scope.go:122] "RemoveContainer" containerID="c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912"
Nov 01 03:53:56.045052 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.045033    5529 scope.go:122] "RemoveContainer" containerID="c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912"
Nov 01 03:53:56.045521 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:53:56.045498    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912\": container with ID starting with c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912 not found: ID does not exist" containerID="c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912"
Nov 01 03:53:56.045605 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.045534    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912"} err="failed to get container status \"c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912\": rpc error: code = NotFound desc = could not find container \"c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912\": container with ID starting with c0db1cf2b1acbaf0b61dacbb09ceaf9e8760349b5dd36b26e8974e92afb70912 not found: ID does not exist"
Nov 01 03:53:56.201082 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.201046    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"]
Nov 01 03:53:56.207252 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.207218    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl"]
Nov 01 03:53:56.353579 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.353488    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx" podUID="56effd65-769d-4987-8751-ceae25086516" containerName="payload-pre-processing" containerID="cri-o://35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612" gracePeriod=25
Nov 01 03:53:56.356147 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.356113    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:56.617171 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.617097    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:53:56.792230 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.792193    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56effd65-769d-4987-8751-ceae25086516-kube-api-access-d6228\" (UniqueName: \"kubernetes.io/projected/56effd65-769d-4987-8751-ceae25086516-kube-api-access-d6228\") pod \"56effd65-769d-4987-8751-ceae25086516\" (UID: \"56effd65-769d-4987-8751-ceae25086516\") "
Nov 01 03:53:56.792415 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.792322    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56effd65-769d-4987-8751-ceae25086516-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56effd65-769d-4987-8751-ceae25086516-plugins-config-volume\") pod \"56effd65-769d-4987-8751-ceae25086516\" (UID: \"56effd65-769d-4987-8751-ceae25086516\") "
Nov 01 03:53:56.792787 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.792751    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56effd65-769d-4987-8751-ceae25086516-plugins-config-volume" pod "56effd65-769d-4987-8751-ceae25086516" (UID: "56effd65-769d-4987-8751-ceae25086516"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 03:53:56.797725 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.797688    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56effd65-769d-4987-8751-ceae25086516-kube-api-access-d6228" pod "56effd65-769d-4987-8751-ceae25086516" (UID: "56effd65-769d-4987-8751-ceae25086516"). InnerVolumeSpecName "kube-api-access-d6228". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:53:56.893317 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.893282    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6228\" (UniqueName: \"kubernetes.io/projected/56effd65-769d-4987-8751-ceae25086516-kube-api-access-d6228\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:56.893317 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.893312    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56effd65-769d-4987-8751-ceae25086516-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:56.915890 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:56.915846    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:57.041894 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.041863    5529 generic.go:356] "Generic (PLEG): container finished" podID="56effd65-769d-4987-8751-ceae25086516" containerID="35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612" exitCode=0
Nov 01 03:53:57.042084 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.041913    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"
Nov 01 03:53:57.042084 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.041951    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx" event={"ID":"56effd65-769d-4987-8751-ceae25086516","Type":"ContainerDied","Data":"35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612"}
Nov 01 03:53:57.042084 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.042006    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx" event={"ID":"56effd65-769d-4987-8751-ceae25086516","Type":"ContainerDied","Data":"bd03a7aafa323a70dfef69aa2c6679cc6e206519c72fb3fd3dd3fc92c7bb3a70"}
Nov 01 03:53:57.042084 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.042034    5529 scope.go:122] "RemoveContainer" containerID="35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612"
Nov 01 03:53:57.054997 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.054971    5529 scope.go:122] "RemoveContainer" containerID="35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612"
Nov 01 03:53:57.055320 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:53:57.055294    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612\": container with ID starting with 35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612 not found: ID does not exist" containerID="35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612"
Nov 01 03:53:57.055403 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.055332    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612"} err="failed to get container status \"35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612\": rpc error: code = NotFound desc = could not find container \"35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612\": container with ID starting with 35a447e3f9270e5713d4315de94d7964fe939217ef270081ecaddb99e3799612 not found: ID does not exist"
Nov 01 03:53:57.210747 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.210663    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"]
Nov 01 03:53:57.261662 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.261628    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3145c214-745849f995-r6jsx"]
Nov 01 03:53:57.289501 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.289451    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:57.372472 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.372437    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b2f7137-13d5-414c-935b-41ec2e2bbb33" path="/var/lib/kubelet/pods/1b2f7137-13d5-414c-935b-41ec2e2bbb33/volumes"
Nov 01 03:53:57.372862 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.372848    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56effd65-769d-4987-8751-ceae25086516" path="/var/lib/kubelet/pods/56effd65-769d-4987-8751-ceae25086516/volumes"
Nov 01 03:53:57.632789 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:57.632753    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:58.028656 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.028577    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:58.231709 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.231673    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:58.464572 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.464542    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:58.564995 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.564950    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6" podUID="8a71d94e-fb91-4826-a13e-9a797a03380c" containerName="payload-processing" containerID="cri-o://f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967" gracePeriod=25
Nov 01 03:53:58.671680 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.671615    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x" podUID="4bdf3481-9844-4af1-92f2-da761a532ccf" containerName="payload-pre-processing" containerID="cri-o://64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826" gracePeriod=25
Nov 01 03:53:58.714378 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.714334    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3145c214-dcc546b74-6dkdl" podUID="1b2f7137-13d5-414c-935b-41ec2e2bbb33" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.43:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 03:53:58.738897 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.738501    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:58.817106 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.817081    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:53:58.916512 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.916485    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a71d94e-fb91-4826-a13e-9a797a03380c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a71d94e-fb91-4826-a13e-9a797a03380c-plugins-config-volume\") pod \"8a71d94e-fb91-4826-a13e-9a797a03380c\" (UID: \"8a71d94e-fb91-4826-a13e-9a797a03380c\") "
Nov 01 03:53:58.916658 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.916532    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a71d94e-fb91-4826-a13e-9a797a03380c-kube-api-access-x4qkc\" (UniqueName: \"kubernetes.io/projected/8a71d94e-fb91-4826-a13e-9a797a03380c-kube-api-access-x4qkc\") pod \"8a71d94e-fb91-4826-a13e-9a797a03380c\" (UID: \"8a71d94e-fb91-4826-a13e-9a797a03380c\") "
Nov 01 03:53:58.917271 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.917243    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a71d94e-fb91-4826-a13e-9a797a03380c-plugins-config-volume" pod "8a71d94e-fb91-4826-a13e-9a797a03380c" (UID: "8a71d94e-fb91-4826-a13e-9a797a03380c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 03:53:58.918776 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.918752    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a71d94e-fb91-4826-a13e-9a797a03380c-kube-api-access-x4qkc" pod "8a71d94e-fb91-4826-a13e-9a797a03380c" (UID: "8a71d94e-fb91-4826-a13e-9a797a03380c"). InnerVolumeSpecName "kube-api-access-x4qkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:53:58.925462 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.925442    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:53:58.942062 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:58.942031    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:59.017227 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.017121    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bdf3481-9844-4af1-92f2-da761a532ccf-kube-api-access-c7j9t\" (UniqueName: \"kubernetes.io/projected/4bdf3481-9844-4af1-92f2-da761a532ccf-kube-api-access-c7j9t\") pod \"4bdf3481-9844-4af1-92f2-da761a532ccf\" (UID: \"4bdf3481-9844-4af1-92f2-da761a532ccf\") "
Nov 01 03:53:59.018055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.017269    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4bdf3481-9844-4af1-92f2-da761a532ccf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bdf3481-9844-4af1-92f2-da761a532ccf-plugins-config-volume\") pod \"4bdf3481-9844-4af1-92f2-da761a532ccf\" (UID: \"4bdf3481-9844-4af1-92f2-da761a532ccf\") "
Nov 01 03:53:59.018055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.017735    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bdf3481-9844-4af1-92f2-da761a532ccf-plugins-config-volume" pod "4bdf3481-9844-4af1-92f2-da761a532ccf" (UID: "4bdf3481-9844-4af1-92f2-da761a532ccf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 03:53:59.018055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.017967    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a71d94e-fb91-4826-a13e-9a797a03380c-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:59.018055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.017992    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4qkc\" (UniqueName: \"kubernetes.io/projected/8a71d94e-fb91-4826-a13e-9a797a03380c-kube-api-access-x4qkc\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:59.018055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.018006    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bdf3481-9844-4af1-92f2-da761a532ccf-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:59.019861 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.019836    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bdf3481-9844-4af1-92f2-da761a532ccf-kube-api-access-c7j9t" pod "4bdf3481-9844-4af1-92f2-da761a532ccf" (UID: "4bdf3481-9844-4af1-92f2-da761a532ccf"). InnerVolumeSpecName "kube-api-access-c7j9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:53:59.057604 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.057567    5529 generic.go:356] "Generic (PLEG): container finished" podID="4bdf3481-9844-4af1-92f2-da761a532ccf" containerID="64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826" exitCode=0
Nov 01 03:53:59.057784 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.057656    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x" event={"ID":"4bdf3481-9844-4af1-92f2-da761a532ccf","Type":"ContainerDied","Data":"64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826"}
Nov 01 03:53:59.057784 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.057717    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x" event={"ID":"4bdf3481-9844-4af1-92f2-da761a532ccf","Type":"ContainerDied","Data":"3287a8dd660817a70510e72ec47061ba23259acace2f6b44d3bd96f7f14475d3"}
Nov 01 03:53:59.057784 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.057750    5529 scope.go:122] "RemoveContainer" containerID="64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826"
Nov 01 03:53:59.057784 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.057659    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"
Nov 01 03:53:59.059332 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.059299    5529 generic.go:356] "Generic (PLEG): container finished" podID="8a71d94e-fb91-4826-a13e-9a797a03380c" containerID="f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967" exitCode=0
Nov 01 03:53:59.059456 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.059340    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"
Nov 01 03:53:59.059456 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.059345    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6" event={"ID":"8a71d94e-fb91-4826-a13e-9a797a03380c","Type":"ContainerDied","Data":"f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967"}
Nov 01 03:53:59.059456 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.059431    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6" event={"ID":"8a71d94e-fb91-4826-a13e-9a797a03380c","Type":"ContainerDied","Data":"5dc533c3a32dd11ad818adccf7140d2ece23e7e8dcb7e9dc0891fd1b8b2fcfb6"}
Nov 01 03:53:59.068279 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.068255    5529 scope.go:122] "RemoveContainer" containerID="64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826"
Nov 01 03:53:59.068615 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:53:59.068585    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826\": container with ID starting with 64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826 not found: ID does not exist" containerID="64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826"
Nov 01 03:53:59.068716 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.068623    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826"} err="failed to get container status \"64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826\": rpc error: code = NotFound desc = could not find container \"64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826\": container with ID starting with 64cde9f6e824c97dc12d7a4ddc64cf414cb90575fe137356f4335d227690e826 not found: ID does not exist"
Nov 01 03:53:59.068716 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.068648    5529 scope.go:122] "RemoveContainer" containerID="f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967"
Nov 01 03:53:59.077741 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.077724    5529 scope.go:122] "RemoveContainer" containerID="f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967"
Nov 01 03:53:59.078020 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:53:59.078000    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967\": container with ID starting with f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967 not found: ID does not exist" containerID="f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967"
Nov 01 03:53:59.078085 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.078032    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967"} err="failed to get container status \"f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967\": rpc error: code = NotFound desc = could not find container \"f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967\": container with ID starting with f68418610042e7ce5d169d6d47e2523ad10a835abd3b3ab84ca60dff6010e967 not found: ID does not exist"
Nov 01 03:53:59.119591 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.119549    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7j9t\" (UniqueName: \"kubernetes.io/projected/4bdf3481-9844-4af1-92f2-da761a532ccf-kube-api-access-c7j9t\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:53:59.195216 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.195178    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:59.203635 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.203609    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"]
Nov 01 03:53:59.216945 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.216915    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f50c3be9-5bbb4f9cdc-255b6"]
Nov 01 03:53:59.339707 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.339622    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"]
Nov 01 03:53:59.342749 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.342718    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-f50c3be9-65879978c-46r4x"]
Nov 01 03:53:59.373278 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.373246    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4bdf3481-9844-4af1-92f2-da761a532ccf" path="/var/lib/kubelet/pods/4bdf3481-9844-4af1-92f2-da761a532ccf/volumes"
Nov 01 03:53:59.373615 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.373603    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a71d94e-fb91-4826-a13e-9a797a03380c" path="/var/lib/kubelet/pods/8a71d94e-fb91-4826-a13e-9a797a03380c/volumes"
Nov 01 03:53:59.404275 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.404245    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:59.614253 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.608125    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:53:59.809537 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:53:59.809502    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:00.008110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:00.008078    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:00.210855 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:00.210822    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:00.461690 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:00.461654    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:00.853516 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:00.853430    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:01.113940 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:01.113857    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:04.344493 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:04.344462    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:04.557000 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:04.556968    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:04.757002 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:04.756958    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:05.185620 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:05.185590    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:05.404272 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:05.404241    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:05.779445 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:05.779407    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:05.989131 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:05.989096    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:07.912047 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:07.912015    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:08.106462 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:08.106425    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:10.152858 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:10.152819    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:12.464808 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:12.464770    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:12.664767 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:12.664722    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:13.828376 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:13.828337    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:14.024149 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.024115    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:14.283916 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:14.283871    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:54:14.379681 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.379647    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"]
Nov 01 03:54:14.379872 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.379849    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb" podUID="2a4de544-1b4b-4d43-85bf-6eb228e431fd" containerName="maas-api" containerID="cri-o://2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a" gracePeriod=30
Nov 01 03:54:14.529745 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.529706    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:14.644126 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.644100    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:54:14.648173 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.648132    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-metrics-certs\") pod \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") "
Nov 01 03:54:14.648308 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.648201    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls\") pod \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") "
Nov 01 03:54:14.648308 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.648282    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a4de544-1b4b-4d43-85bf-6eb228e431fd-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4de544-1b4b-4d43-85bf-6eb228e431fd-openshift-service-ca\") pod \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") "
Nov 01 03:54:14.648433 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.648309    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a4de544-1b4b-4d43-85bf-6eb228e431fd-kube-api-access-kp5f2\" (UniqueName: \"kubernetes.io/projected/2a4de544-1b4b-4d43-85bf-6eb228e431fd-kube-api-access-kp5f2\") pod \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\" (UID: \"2a4de544-1b4b-4d43-85bf-6eb228e431fd\") "
Nov 01 03:54:14.648625 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.648596    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a4de544-1b4b-4d43-85bf-6eb228e431fd-openshift-service-ca" pod "2a4de544-1b4b-4d43-85bf-6eb228e431fd" (UID: "2a4de544-1b4b-4d43-85bf-6eb228e431fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 03:54:14.650293 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.650269    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-metrics-certs" pod "2a4de544-1b4b-4d43-85bf-6eb228e431fd" (UID: "2a4de544-1b4b-4d43-85bf-6eb228e431fd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:54:14.650390 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.650287    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls" pod "2a4de544-1b4b-4d43-85bf-6eb228e431fd" (UID: "2a4de544-1b4b-4d43-85bf-6eb228e431fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:54:14.650446 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.650388    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a4de544-1b4b-4d43-85bf-6eb228e431fd-kube-api-access-kp5f2" pod "2a4de544-1b4b-4d43-85bf-6eb228e431fd" (UID: "2a4de544-1b4b-4d43-85bf-6eb228e431fd"). InnerVolumeSpecName "kube-api-access-kp5f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:54:14.749139 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.749094    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:54:14.749139 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.749135    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a4de544-1b4b-4d43-85bf-6eb228e431fd-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:54:14.749139 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.749147    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp5f2\" (UniqueName: \"kubernetes.io/projected/2a4de544-1b4b-4d43-85bf-6eb228e431fd-kube-api-access-kp5f2\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:54:14.749139 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:14.749156    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a4de544-1b4b-4d43-85bf-6eb228e431fd-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:54:15.155553 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.155519    5529 generic.go:356] "Generic (PLEG): container finished" podID="2a4de544-1b4b-4d43-85bf-6eb228e431fd" containerID="2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a" exitCode=0
Nov 01 03:54:15.155985 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.155572    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"
Nov 01 03:54:15.155985 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.155604    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb" event={"ID":"2a4de544-1b4b-4d43-85bf-6eb228e431fd","Type":"ContainerDied","Data":"2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a"}
Nov 01 03:54:15.155985 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.155663    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb" event={"ID":"2a4de544-1b4b-4d43-85bf-6eb228e431fd","Type":"ContainerDied","Data":"2d693a9015e99173ccdaa4eec69f11c1751ede453935b3503f2a79ead29478f0"}
Nov 01 03:54:15.155985 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.155694    5529 scope.go:122] "RemoveContainer" containerID="2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a"
Nov 01 03:54:15.165508 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.165488    5529 scope.go:122] "RemoveContainer" containerID="2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a"
Nov 01 03:54:15.165798 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:15.165776    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a\": container with ID starting with 2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a not found: ID does not exist" containerID="2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a"
Nov 01 03:54:15.165881 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.165805    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a"} err="failed to get container status \"2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a\": rpc error: code = NotFound desc = could not find container \"2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a\": container with ID starting with 2600ecb30732dae0915d4309a395af6651f64cd5d8c30c89506e2a304224fa8a not found: ID does not exist"
Nov 01 03:54:15.322760 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.322608    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"]
Nov 01 03:54:15.373000 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.372970    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48d2fd87-c4ffd8576-j4jcb"]
Nov 01 03:54:15.996086 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996054    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"]
Nov 01 03:54:15.996465 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996451    5529 cpu_manager.go:414] "containerMap: removing container" podUID="56effd65-769d-4987-8751-ceae25086516" containerName="payload-pre-processing"
Nov 01 03:54:15.996511 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996468    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56effd65-769d-4987-8751-ceae25086516" containerName="payload-pre-processing"
Nov 01 03:54:15.996511 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996487    5529 cpu_manager.go:414] "containerMap: removing container" podUID="1b2f7137-13d5-414c-935b-41ec2e2bbb33" containerName="maas-api"
Nov 01 03:54:15.996511 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996492    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b2f7137-13d5-414c-935b-41ec2e2bbb33" containerName="maas-api"
Nov 01 03:54:15.996511 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996500    5529 cpu_manager.go:414] "containerMap: removing container" podUID="4bdf3481-9844-4af1-92f2-da761a532ccf" containerName="payload-pre-processing"
Nov 01 03:54:15.996511 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996506    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bdf3481-9844-4af1-92f2-da761a532ccf" containerName="payload-pre-processing"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996517    5529 cpu_manager.go:414] "containerMap: removing container" podUID="2a4de544-1b4b-4d43-85bf-6eb228e431fd" containerName="maas-api"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996523    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a4de544-1b4b-4d43-85bf-6eb228e431fd" containerName="maas-api"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996536    5529 cpu_manager.go:414] "containerMap: removing container" podUID="8a71d94e-fb91-4826-a13e-9a797a03380c" containerName="payload-processing"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996541    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a71d94e-fb91-4826-a13e-9a797a03380c" containerName="payload-processing"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996620    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="56effd65-769d-4987-8751-ceae25086516" containerName="payload-pre-processing"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996628    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b2f7137-13d5-414c-935b-41ec2e2bbb33" containerName="maas-api"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996633    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="4bdf3481-9844-4af1-92f2-da761a532ccf" containerName="payload-pre-processing"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996639    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a4de544-1b4b-4d43-85bf-6eb228e431fd" containerName="maas-api"
Nov 01 03:54:15.996657 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:15.996645    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a71d94e-fb91-4826-a13e-9a797a03380c" containerName="payload-processing"
Nov 01 03:54:16.001367 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.001348    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.054023 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.053986    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-a9c5b3-serving-cert\""
Nov 01 03:54:16.060599 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.060568    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvpzv\" (UniqueName: \"kubernetes.io/projected/f5c26be4-de55-4802-8e90-267eb51ba055-kube-api-access-tvpzv\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.060740 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.060620    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c26be4-de55-4802-8e90-267eb51ba055-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.060779 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.060745    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-metrics-certs\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.060820 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.060778    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.100981 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.100943    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:16.106966 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.106938    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"]
Nov 01 03:54:16.161726 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.161689    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c26be4-de55-4802-8e90-267eb51ba055-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.162208 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.161741    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-metrics-certs\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.162208 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.161760    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.162208 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.161800    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvpzv\" (UniqueName: \"kubernetes.io/projected/f5c26be4-de55-4802-8e90-267eb51ba055-kube-api-access-tvpzv\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.164057 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:16.164027    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-serving-cert: secret "maas-api-e2e-worker-w4-a9c5b3-serving-cert" not found
Nov 01 03:54:16.164408 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.164380    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c26be4-de55-4802-8e90-267eb51ba055-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.165112 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:16.165050    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls podName:f5c26be4-de55-4802-8e90-267eb51ba055 nodeName:}" failed. No retries permitted until 2026-11-01 03:54:16.66502094 +0000 UTC m=+677.424748729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls") pod "maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m" (UID: "f5c26be4-de55-4802-8e90-267eb51ba055") : secret "maas-api-e2e-worker-w4-a9c5b3-serving-cert" not found
Nov 01 03:54:16.166540 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.166514    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-metrics-certs\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.225091 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.225060    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvpzv\" (UniqueName: \"kubernetes.io/projected/f5c26be4-de55-4802-8e90-267eb51ba055-kube-api-access-tvpzv\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.301628 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.301521    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:16.496746 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.496702    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:16.667661 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.667624    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.670047 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.670025    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls\") pod \"maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:16.717996 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.717931    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:16.914050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:16.914011    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:17.096979 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:17.096942    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:17.300606 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:17.300519    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"]
Nov 01 03:54:17.303692 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:17.303657    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:17.304554 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:54:17.304531    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c26be4_de55_4802_8e90_267eb51ba055.slice/crio-3f3b5559ed0a13299426392aaf46884facb526a7e6e9d4405c9ee33a4c24e8c3 WatchSource:0}: Error finding container 3f3b5559ed0a13299426392aaf46884facb526a7e6e9d4405c9ee33a4c24e8c3: Status 404 returned error can't find the container with id 3f3b5559ed0a13299426392aaf46884facb526a7e6e9d4405c9ee33a4c24e8c3
Nov 01 03:54:17.374266 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:17.374229    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a4de544-1b4b-4d43-85bf-6eb228e431fd" path="/var/lib/kubelet/pods/2a4de544-1b4b-4d43-85bf-6eb228e431fd/volumes"
Nov 01 03:54:17.513225 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:17.513178    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:18.093277 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:18.093241    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:18.200285 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:18.200249    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m" event={"ID":"f5c26be4-de55-4802-8e90-267eb51ba055","Type":"ContainerStarted","Data":"3f3b5559ed0a13299426392aaf46884facb526a7e6e9d4405c9ee33a4c24e8c3"}
Nov 01 03:54:18.292353 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:18.292317    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:19.207056 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:19.207022    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m" event={"ID":"f5c26be4-de55-4802-8e90-267eb51ba055","Type":"ContainerStarted","Data":"6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2"}
Nov 01 03:54:19.207478 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:19.207158    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:19.327462 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:19.327412    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m" podStartSLOduration=3.314081833 podStartE2EDuration="4.327396214s" totalImagesPullingTime="1.013314381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:54:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:54:19.325704588 +0000 UTC m=+680.085432383" watchObservedRunningTime="2026-11-01 03:54:19.327396214 +0000 UTC m=+680.087124009"
Nov 01 03:54:21.830801 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:21.830769    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:22.024203 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:22.024144    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:24.162138 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:24.162072    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:24.385421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:24.385383    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:25.220419 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:25.220392    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 03:54:27.329305 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:27.329274    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:30.554320 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:30.554282    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:30.760687 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:30.760651    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:30.913913 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:30.913876    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"]
Nov 01 03:54:30.918512 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:30.918486    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:30.971341 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:30.971305    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"]
Nov 01 03:54:30.990038 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:30.989997    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jmcd\" (UniqueName: \"kubernetes.io/projected/36feab29-2aec-4575-9239-e821865b9336-kube-api-access-6jmcd\") pod \"payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk\" (UID: \"36feab29-2aec-4575-9239-e821865b9336\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:30.990289 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:30.990090    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36feab29-2aec-4575-9239-e821865b9336-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk\" (UID: \"36feab29-2aec-4575-9239-e821865b9336\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:31.018855 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:31.018826    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-865066\""
Nov 01 03:54:31.019036 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:31.018933    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-865066-dockercfg-qr8g4\""
Nov 01 03:54:31.090727 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:31.090632    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36feab29-2aec-4575-9239-e821865b9336-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk\" (UID: \"36feab29-2aec-4575-9239-e821865b9336\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:31.090926 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:31.090744    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jmcd\" (UniqueName: \"kubernetes.io/projected/36feab29-2aec-4575-9239-e821865b9336-kube-api-access-6jmcd\") pod \"payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk\" (UID: \"36feab29-2aec-4575-9239-e821865b9336\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:31.091449 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:31.091421    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36feab29-2aec-4575-9239-e821865b9336-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk\" (UID: \"36feab29-2aec-4575-9239-e821865b9336\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:31.156204 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:31.156153    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jmcd\" (UniqueName: \"kubernetes.io/projected/36feab29-2aec-4575-9239-e821865b9336-kube-api-access-6jmcd\") pod \"payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk\" (UID: \"36feab29-2aec-4575-9239-e821865b9336\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:31.233128 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:31.233045    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:31.611254 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:31.611181    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"]
Nov 01 03:54:31.614429 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:54:31.614385    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36feab29_2aec_4575_9239_e821865b9336.slice/crio-9b0eb863ebcd7ada549333b48cd397e959067f068ffe70c4e4f591a9b5d22d4b WatchSource:0}: Error finding container 9b0eb863ebcd7ada549333b48cd397e959067f068ffe70c4e4f591a9b5d22d4b: Status 404 returned error can't find the container with id 9b0eb863ebcd7ada549333b48cd397e959067f068ffe70c4e4f591a9b5d22d4b
Nov 01 03:54:32.284935 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.284894    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk" event={"ID":"36feab29-2aec-4575-9239-e821865b9336","Type":"ContainerStarted","Data":"0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348"}
Nov 01 03:54:32.285137 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.284957    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk" event={"ID":"36feab29-2aec-4575-9239-e821865b9336","Type":"ContainerStarted","Data":"9b0eb863ebcd7ada549333b48cd397e959067f068ffe70c4e4f591a9b5d22d4b"}
Nov 01 03:54:32.285137 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.285055    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:32.390729 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.390695    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"]
Nov 01 03:54:32.394251 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.394232    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.401481 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.401450    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e52bdd-e5c4-458b-96db-9f6570c3391d-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.401633 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.401491    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-metrics-certs\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.401633 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.401616    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknx9\" (UniqueName: \"kubernetes.io/projected/66e52bdd-e5c4-458b-96db-9f6570c3391d-kube-api-access-gknx9\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.401731 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.401700    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.405223 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.405195    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"]
Nov 01 03:54:32.407000 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.406953    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk" podStartSLOduration=2.406939539 podStartE2EDuration="2.406939539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:54:32.404325355 +0000 UTC m=+693.164053151" watchObservedRunningTime="2026-11-01 03:54:32.406939539 +0000 UTC m=+693.166667334"
Nov 01 03:54:32.447421 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.447388    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-f73b9f-serving-cert\""
Nov 01 03:54:32.502698 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.502663    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e52bdd-e5c4-458b-96db-9f6570c3391d-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.502698 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.502699    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-metrics-certs\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.502950 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.502744    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gknx9\" (UniqueName: \"kubernetes.io/projected/66e52bdd-e5c4-458b-96db-9f6570c3391d-kube-api-access-gknx9\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.502950 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.502766    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.502950 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:32.502886    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-serving-cert: secret "maas-api-e2e-worker-w3-f73b9f-serving-cert" not found
Nov 01 03:54:32.503114 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:32.502957    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls podName:66e52bdd-e5c4-458b-96db-9f6570c3391d nodeName:}" failed. No retries permitted until 2026-11-01 03:54:33.002937387 +0000 UTC m=+693.762665159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls") pod "maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm" (UID: "66e52bdd-e5c4-458b-96db-9f6570c3391d") : secret "maas-api-e2e-worker-w3-f73b9f-serving-cert" not found
Nov 01 03:54:32.503355 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.503328    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e52bdd-e5c4-458b-96db-9f6570c3391d-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.505244 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.505221    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-metrics-certs\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.564793 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.564717    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknx9\" (UniqueName: \"kubernetes.io/projected/66e52bdd-e5c4-458b-96db-9f6570c3391d-kube-api-access-gknx9\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:32.651704 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.651674    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:32.856812 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:32.856730    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:33.006349 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:33.006309    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:33.008700 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:33.008680    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls\") pod \"maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:33.010611 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:33.010570    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:33.060842 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:33.060376    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:33.388309 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:33.388276    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"]
Nov 01 03:54:33.391449 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:54:33.391422    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e52bdd_e5c4_458b_96db_9f6570c3391d.slice/crio-70228f25ed68fd7876080b174e6a76712eb022377b3e94996e3656eedf2a36df WatchSource:0}: Error finding container 70228f25ed68fd7876080b174e6a76712eb022377b3e94996e3656eedf2a36df: Status 404 returned error can't find the container with id 70228f25ed68fd7876080b174e6a76712eb022377b3e94996e3656eedf2a36df
Nov 01 03:54:34.297002 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:34.296969    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm" event={"ID":"66e52bdd-e5c4-458b-96db-9f6570c3391d","Type":"ContainerStarted","Data":"70228f25ed68fd7876080b174e6a76712eb022377b3e94996e3656eedf2a36df"}
Nov 01 03:54:35.303965 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:35.303929    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm" event={"ID":"66e52bdd-e5c4-458b-96db-9f6570c3391d","Type":"ContainerStarted","Data":"ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5"}
Nov 01 03:54:35.304455 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:35.304081    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:35.428496 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:35.428440    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm" podStartSLOduration=2.524379048 podStartE2EDuration="3.428425214s" totalImagesPullingTime="904.046166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:54:35.427823194 +0000 UTC m=+696.187550988" watchObservedRunningTime="2026-11-01 03:54:35.428425214 +0000 UTC m=+696.188153009"
Nov 01 03:54:37.483678 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.483644    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"]
Nov 01 03:54:37.484202 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.483876    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb" podUID="93a01123-7a15-4a86-9619-1f120b356db3" containerName="maas-api" containerID="cri-o://e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3" gracePeriod=30
Nov 01 03:54:37.639880 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.639846    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:37.741576 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.741512    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:54:37.859213 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.859158    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/93a01123-7a15-4a86-9619-1f120b356db3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a01123-7a15-4a86-9619-1f120b356db3-openshift-service-ca\") pod \"93a01123-7a15-4a86-9619-1f120b356db3\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") "
Nov 01 03:54:37.859400 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.859272    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93a01123-7a15-4a86-9619-1f120b356db3-kube-api-access-7sg2n\" (UniqueName: \"kubernetes.io/projected/93a01123-7a15-4a86-9619-1f120b356db3-kube-api-access-7sg2n\") pod \"93a01123-7a15-4a86-9619-1f120b356db3\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") "
Nov 01 03:54:37.859400 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.859309    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-maas-api-tls\") pod \"93a01123-7a15-4a86-9619-1f120b356db3\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") "
Nov 01 03:54:37.859400 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.859342    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-metrics-certs\") pod \"93a01123-7a15-4a86-9619-1f120b356db3\" (UID: \"93a01123-7a15-4a86-9619-1f120b356db3\") "
Nov 01 03:54:37.859633 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.859608    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a01123-7a15-4a86-9619-1f120b356db3-openshift-service-ca" pod "93a01123-7a15-4a86-9619-1f120b356db3" (UID: "93a01123-7a15-4a86-9619-1f120b356db3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 03:54:37.861788 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.861746    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-metrics-certs" pod "93a01123-7a15-4a86-9619-1f120b356db3" (UID: "93a01123-7a15-4a86-9619-1f120b356db3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:54:37.862204 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.862180    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-maas-api-tls" pod "93a01123-7a15-4a86-9619-1f120b356db3" (UID: "93a01123-7a15-4a86-9619-1f120b356db3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 03:54:37.863406 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.863379    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a01123-7a15-4a86-9619-1f120b356db3-kube-api-access-7sg2n" pod "93a01123-7a15-4a86-9619-1f120b356db3" (UID: "93a01123-7a15-4a86-9619-1f120b356db3"). InnerVolumeSpecName "kube-api-access-7sg2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 03:54:37.960957 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.960919    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a01123-7a15-4a86-9619-1f120b356db3-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:54:37.960957 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.960950    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sg2n\" (UniqueName: \"kubernetes.io/projected/93a01123-7a15-4a86-9619-1f120b356db3-kube-api-access-7sg2n\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:54:37.960957 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.960961    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:54:37.961232 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:37.960971    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a01123-7a15-4a86-9619-1f120b356db3-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 03:54:38.322430 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.322391    5529 generic.go:356] "Generic (PLEG): container finished" podID="93a01123-7a15-4a86-9619-1f120b356db3" containerID="e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3" exitCode=0
Nov 01 03:54:38.322623 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.322438    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"
Nov 01 03:54:38.322623 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.322470    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb" event={"ID":"93a01123-7a15-4a86-9619-1f120b356db3","Type":"ContainerDied","Data":"e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3"}
Nov 01 03:54:38.322623 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.322531    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb" event={"ID":"93a01123-7a15-4a86-9619-1f120b356db3","Type":"ContainerDied","Data":"3a950c7eee9adb1f588ea1de70e5c3966af4c514ffbfda9b870c837debddddf4"}
Nov 01 03:54:38.322623 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.322562    5529 scope.go:122] "RemoveContainer" containerID="e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3"
Nov 01 03:54:38.333746 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.333724    5529 scope.go:122] "RemoveContainer" containerID="e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3"
Nov 01 03:54:38.334041 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:38.334023    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3\": container with ID starting with e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3 not found: ID does not exist" containerID="e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3"
Nov 01 03:54:38.334110 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.334050    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3"} err="failed to get container status \"e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3\": rpc error: code = NotFound desc = could not find container \"e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3\": container with ID starting with e46d0eec6b2c1e74454325122b061f011d21d171d308356ce14f8bea06e6b3c3 not found: ID does not exist"
Nov 01 03:54:38.489105 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.489068    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"]
Nov 01 03:54:38.494601 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:38.494574    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6800c12d-6cb88c48-svmbb"]
Nov 01 03:54:39.283038 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:39.283001    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:39.372764 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:39.372725    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93a01123-7a15-4a86-9619-1f120b356db3" path="/var/lib/kubelet/pods/93a01123-7a15-4a86-9619-1f120b356db3/volumes"
Nov 01 03:54:39.502300 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:39.502265    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:39.704145 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:39.704108    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:39.919586 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:39.919552    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:40.804913 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:40.804857    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:41.314923 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:41.314894    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 03:54:41.398534 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:41.398474    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:41.598428 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:41.598332    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:43.293804 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:43.293747    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 03:54:44.284380 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:44.284343    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:54:44.673307 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.673278    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"]
Nov 01 03:54:44.673796 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.673668    5529 cpu_manager.go:414] "containerMap: removing container" podUID="93a01123-7a15-4a86-9619-1f120b356db3" containerName="maas-api"
Nov 01 03:54:44.673796 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.673679    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93a01123-7a15-4a86-9619-1f120b356db3" containerName="maas-api"
Nov 01 03:54:44.673796 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.673758    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="93a01123-7a15-4a86-9619-1f120b356db3" containerName="maas-api"
Nov 01 03:54:44.676968 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.676947    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.726018 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.725983    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/900cf90d-b8f8-4b80-bdfb-9f34552d7677-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.726213 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.726036    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-metrics-certs\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.726213 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.726191    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk6zj\" (UniqueName: \"kubernetes.io/projected/900cf90d-b8f8-4b80-bdfb-9f34552d7677-kube-api-access-dk6zj\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.726299 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.726238    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.729643 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.729603    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-865066-serving-cert\""
Nov 01 03:54:44.783399 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.783365    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"]
Nov 01 03:54:44.827375 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.827332    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/900cf90d-b8f8-4b80-bdfb-9f34552d7677-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.827575 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.827382    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-metrics-certs\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.827575 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.827417    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk6zj\" (UniqueName: \"kubernetes.io/projected/900cf90d-b8f8-4b80-bdfb-9f34552d7677-kube-api-access-dk6zj\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.827575 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.827438    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.827762 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:44.827576    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-serving-cert: secret "maas-api-e2e-worker-w2-865066-serving-cert" not found
Nov 01 03:54:44.827762 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:54:44.827653    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls podName:900cf90d-b8f8-4b80-bdfb-9f34552d7677 nodeName:}" failed. No retries permitted until 2026-11-01 03:54:45.327634284 +0000 UTC m=+706.087362072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls") pod "maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf" (UID: "900cf90d-b8f8-4b80-bdfb-9f34552d7677") : secret "maas-api-e2e-worker-w2-865066-serving-cert" not found
Nov 01 03:54:44.828206 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.828146    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/900cf90d-b8f8-4b80-bdfb-9f34552d7677-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.830115 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.830094    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-metrics-certs\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.889321 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.889294    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk6zj\" (UniqueName: \"kubernetes.io/projected/900cf90d-b8f8-4b80-bdfb-9f34552d7677-kube-api-access-dk6zj\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:44.935650 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:44.935554    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:45.132834 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:45.132779    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:45.331330 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:45.331242    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:45.331723 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:45.331703    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:45.334142 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:45.334114    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls\") pod \"maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:45.590489 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:45.590401    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:45.979502 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:45.979465    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"]
Nov 01 03:54:45.982547 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:54:45.982517    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900cf90d_b8f8_4b80_bdfb_9f34552d7677.slice/crio-5d32c76b5bd8e322b731e04ac8e568ba8a81d85530ef9221f213d52be2f264b7 WatchSource:0}: Error finding container 5d32c76b5bd8e322b731e04ac8e568ba8a81d85530ef9221f213d52be2f264b7: Status 404 returned error can't find the container with id 5d32c76b5bd8e322b731e04ac8e568ba8a81d85530ef9221f213d52be2f264b7
Nov 01 03:54:46.369017 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:46.368932    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf" event={"ID":"900cf90d-b8f8-4b80-bdfb-9f34552d7677","Type":"ContainerStarted","Data":"5d32c76b5bd8e322b731e04ac8e568ba8a81d85530ef9221f213d52be2f264b7"}
Nov 01 03:54:47.375093 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:47.375057    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf" event={"ID":"900cf90d-b8f8-4b80-bdfb-9f34552d7677","Type":"ContainerStarted","Data":"ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835"}
Nov 01 03:54:47.375525 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:47.375158    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:47.495217 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:47.495149    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf" podStartSLOduration=2.607446262 podStartE2EDuration="3.495133441s" totalImagesPullingTime="887.687179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:54:47.493067388 +0000 UTC m=+708.252795185" watchObservedRunningTime="2026-11-01 03:54:47.495133441 +0000 UTC m=+708.254861235"
Nov 01 03:54:47.527252 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:47.527199    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:47.733012 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:47.732921    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:49.674794 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:49.674761    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:50.256873 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:50.256837    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:50.476021 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:50.475986    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:50.686373 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:50.686341    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:52.413836 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:52.413801    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:52.609241 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:52.609210    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:52.920671 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:52.920639    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"]
Nov 01 03:54:52.924488 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:52.924465    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:52.977435 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:52.977401    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-c2c259\""
Nov 01 03:54:52.980588 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:52.980557    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"]
Nov 01 03:54:53.004683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.004651    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg\" (UID: \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:53.004844 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.004687    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnmq9\" (UniqueName: \"kubernetes.io/projected/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-kube-api-access-pnmq9\") pod \"payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg\" (UID: \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:53.027336 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.027295    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-c2c259-dockercfg-nx6dj\""
Nov 01 03:54:53.105897 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.105859    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg\" (UID: \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:53.105897 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.105898    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnmq9\" (UniqueName: \"kubernetes.io/projected/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-kube-api-access-pnmq9\") pod \"payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg\" (UID: \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:53.106594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.106568    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg\" (UID: \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:53.168128 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.168088    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnmq9\" (UniqueName: \"kubernetes.io/projected/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-kube-api-access-pnmq9\") pod \"payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg\" (UID: \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:53.238100 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.237997    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:53.387033 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.387003    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 03:54:53.626681 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.626622    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"]
Nov 01 03:54:53.637866 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:54:53.637801    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca6e3d4_6fbd_4fe3_96eb_1ed70ab85568.slice/crio-49521c41264dafd653a69eece3c86af42784fac53209c908a8d3a5f12a699f4a WatchSource:0}: Error finding container 49521c41264dafd653a69eece3c86af42784fac53209c908a8d3a5f12a699f4a: Status 404 returned error can't find the container with id 49521c41264dafd653a69eece3c86af42784fac53209c908a8d3a5f12a699f4a
Nov 01 03:54:53.737767 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:53.737731    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:54:54.416089 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:54.416055    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg" event={"ID":"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568","Type":"ContainerStarted","Data":"362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae"}
Nov 01 03:54:54.416331 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:54.416115    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg" event={"ID":"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568","Type":"ContainerStarted","Data":"49521c41264dafd653a69eece3c86af42784fac53209c908a8d3a5f12a699f4a"}
Nov 01 03:54:54.416331 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:54.416252    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:54:54.532636 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:54.532582    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg" podStartSLOduration=2.532568926 podStartE2EDuration="2.532568926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:54:54.532175943 +0000 UTC m=+715.291903734" watchObservedRunningTime="2026-11-01 03:54:54.532568926 +0000 UTC m=+715.292296720"
Nov 01 03:54:55.725021 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:54:55.724986    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:00.090104 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:00.090069    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:00.668856 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:00.668823    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:00.876362 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:00.876330    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:01.077788 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:01.077668    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:04.686633 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:04.686601    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:05.425239 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:05.425208    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 03:55:06.109576 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:06.109520    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:11.379973 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:11.379902    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:11.595397 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:11.595368    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:11.807766 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:11.807692    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:12.021805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:12.021765    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:12.223491 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:12.223444    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:14.283436 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:55:14.283403    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:55:16.699884 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:16.699846    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:18.671666 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.671632    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"]
Nov 01 03:55:18.675469 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.675454    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.729988 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.729959    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"]
Nov 01 03:55:18.739829 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.739795    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-162191\"/\"default-dockercfg-2zg92\""
Nov 01 03:55:18.739829 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.739789    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-162191\"/\"openshift-service-ca.crt\""
Nov 01 03:55:18.742269 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.742245    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-tmp-dir\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.742365 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.742297    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e801116-8707-43b2-94b7-c10bf6b348ba-tls-certs\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.742413 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.742395    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-model-cache\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.742468 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.742453    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-home\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.742503 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.742490    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncrb4\" (UniqueName: \"kubernetes.io/projected/2e801116-8707-43b2-94b7-c10bf6b348ba-kube-api-access-ncrb4\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.742581 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.742568    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-dshm\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.743013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.742999    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-162191\"/\"kube-root-ca.crt\""
Nov 01 03:55:18.777780 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.777747    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-162191\"/\"simulator-w0-162191-kserve-self-signed-certs\""
Nov 01 03:55:18.815653 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.815624    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:18.843870 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.843840    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-model-cache\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.844054 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.843878    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-home\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.844054 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.843910    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncrb4\" (UniqueName: \"kubernetes.io/projected/2e801116-8707-43b2-94b7-c10bf6b348ba-kube-api-access-ncrb4\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.844054 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.843956    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-dshm\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.844054 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.844008    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-tmp-dir\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.844309 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.844065    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e801116-8707-43b2-94b7-c10bf6b348ba-tls-certs\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.844406 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.844373    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-model-cache\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.844517 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.844382    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-home\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.844517 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.844472    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-tmp-dir\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.846319 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.846299    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-dshm\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.846566 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.846548    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e801116-8707-43b2-94b7-c10bf6b348ba-tls-certs\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.905644 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.905609    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncrb4\" (UniqueName: \"kubernetes.io/projected/2e801116-8707-43b2-94b7-c10bf6b348ba-kube-api-access-ncrb4\") pod \"simulator-w0-162191-kserve-768796ddd7-jb8rk\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") " pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:18.987736 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:18.987626    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:19.373116 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:55:19.373084    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e801116_8707_43b2_94b7_c10bf6b348ba.slice/crio-f9c95c19d0bc470c540946f4d0282d9afed6d6ac710f32e3c61176de0c8600d9 WatchSource:0}: Error finding container f9c95c19d0bc470c540946f4d0282d9afed6d6ac710f32e3c61176de0c8600d9: Status 404 returned error can't find the container with id f9c95c19d0bc470c540946f4d0282d9afed6d6ac710f32e3c61176de0c8600d9
Nov 01 03:55:19.373397 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:19.373379    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"]
Nov 01 03:55:19.553929 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:19.553884    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" event={"ID":"2e801116-8707-43b2-94b7-c10bf6b348ba","Type":"ContainerStarted","Data":"f9c95c19d0bc470c540946f4d0282d9afed6d6ac710f32e3c61176de0c8600d9"}
Nov 01 03:55:21.745395 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:21.745362    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:22.583946 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:22.583900    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" event={"ID":"2e801116-8707-43b2-94b7-c10bf6b348ba","Type":"ContainerStarted","Data":"0cbbc02a67587c59b6f57c933791dd113bb68958b8bec9d9d6b78f9c3a856845"}
Nov 01 03:55:22.705283 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:22.705230    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" podStartSLOduration=2.387654135 podStartE2EDuration="4.705213505s" totalImagesPullingTime="2.31755937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:55:22.70272811 +0000 UTC m=+743.462455906" watchObservedRunningTime="2026-11-01 03:55:22.705213505 +0000 UTC m=+743.464941300"
Nov 01 03:55:22.988695 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:22.988658    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:23.655502 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:23.655468    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:24.269105 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:24.269069    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:24.497919 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:24.497884    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:25.476653 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:25.476624    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:27.115431 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:27.115383    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:28.987878 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:28.987842    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:29.000297 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:29.000271    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:29.636943 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:29.636911    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 03:55:32.122590 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:32.122547    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:37.110824 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:37.110780    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:42.045487 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:42.045441    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:42.243391 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:42.243356    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:44.284382 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:55:44.284347    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:55:44.785947 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.785908    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"]
Nov 01 03:55:44.789613 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.789591    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.889999 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.889957    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-model-cache\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.890251 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.890019    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-home\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.890251 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.890121    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/976129b2-49b6-4c5f-881b-c7210355fc30-tls-certs\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.890251 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.890211    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdk2\" (UniqueName: \"kubernetes.io/projected/976129b2-49b6-4c5f-881b-c7210355fc30-kube-api-access-hrdk2\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.890427 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.890258    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-dshm\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.890427 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.890348    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-tmp-dir\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.893970 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.893936    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a9c5b3\"/\"default-dockercfg-fvxkt\""
Nov 01 03:55:44.894106 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.894020    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a9c5b3\"/\"openshift-service-ca.crt\""
Nov 01 03:55:44.894106 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.894036    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-a9c5b3\"/\"premium-w4-a9c5b3-kserve-self-signed-certs\""
Nov 01 03:55:44.894106 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.894059    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-a9c5b3\"/\"kube-root-ca.crt\""
Nov 01 03:55:44.896408 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.896387    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"]
Nov 01 03:55:44.927491 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.927453    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:44.991222 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.991183    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdk2\" (UniqueName: \"kubernetes.io/projected/976129b2-49b6-4c5f-881b-c7210355fc30-kube-api-access-hrdk2\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.991423 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.991238    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-dshm\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.991423 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.991271    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-tmp-dir\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.991423 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.991338    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-model-cache\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.991423 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.991395    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-home\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.991654 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.991469    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/976129b2-49b6-4c5f-881b-c7210355fc30-tls-certs\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.991803 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.991777    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-model-cache\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.991931 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.991825    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-home\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.992055 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.992024    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-tmp-dir\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.994015 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.993987    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-dshm\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:44.994316 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:44.994297    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/976129b2-49b6-4c5f-881b-c7210355fc30-tls-certs\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:45.052655 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:45.052576    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdk2\" (UniqueName: \"kubernetes.io/projected/976129b2-49b6-4c5f-881b-c7210355fc30-kube-api-access-hrdk2\") pod \"premium-w4-a9c5b3-kserve-5d78db798f-8xksf\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") " pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:45.101195 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:45.101131    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:45.494144 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:45.494108    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"]
Nov 01 03:55:45.497861 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:55:45.497828    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod976129b2_49b6_4c5f_881b_c7210355fc30.slice/crio-18eef9e89b4a809af9a7df906f1dc29772c4b53df92b2e5556783c5a8c333ad5 WatchSource:0}: Error finding container 18eef9e89b4a809af9a7df906f1dc29772c4b53df92b2e5556783c5a8c333ad5: Status 404 returned error can't find the container with id 18eef9e89b4a809af9a7df906f1dc29772c4b53df92b2e5556783c5a8c333ad5
Nov 01 03:55:45.718315 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:45.718264    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" event={"ID":"976129b2-49b6-4c5f-881b-c7210355fc30","Type":"ContainerStarted","Data":"bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d"}
Nov 01 03:55:45.718484 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:45.718325    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" event={"ID":"976129b2-49b6-4c5f-881b-c7210355fc30","Type":"ContainerStarted","Data":"18eef9e89b4a809af9a7df906f1dc29772c4b53df92b2e5556783c5a8c333ad5"}
Nov 01 03:55:45.836339 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:45.836233    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" podStartSLOduration=1.8362181789999998 podStartE2EDuration="1.836218179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:55:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:55:45.835108014 +0000 UTC m=+766.594835832" watchObservedRunningTime="2026-11-01 03:55:45.836218179 +0000 UTC m=+766.595945973"
Nov 01 03:55:46.101914 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:46.101826    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:46.974808 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:46.974773    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:51.021374 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:51.021335    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:51.741211 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:51.741145    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:52.304564 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:52.304514    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:52.504506 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:52.504476    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:55:55.101440 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:55.101404    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:55.114124 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:55.114092    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:55.794629 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:55.794591    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 03:55:57.344568 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:55:57.344533    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:02.309068 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:02.309031    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:05.038018 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:05.037985    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:05.339322 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:05.339219    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:06.659244 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.659201    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"]
Nov 01 03:56:06.664559 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.664536    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.716605 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.716564    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-model-cache\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.716769 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.716726    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-dshm\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.716845 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.716822    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xts82\" (UniqueName: \"kubernetes.io/projected/058a1cb2-3d68-438b-b0dc-b04d8d3da593-kube-api-access-xts82\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.716954 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.716928    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tmp-dir\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.717013 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.716985    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-home\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.717380 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.717012    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tls-certs\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.718671 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.718646    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"]
Nov 01 03:56:06.765265 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.765227    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-162191\"/\"premium-w0-162191-kserve-self-signed-certs\""
Nov 01 03:56:06.804344 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.804311    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:06.818594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.818560    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-model-cache\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.818763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.818616    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-dshm\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.818763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.818641    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xts82\" (UniqueName: \"kubernetes.io/projected/058a1cb2-3d68-438b-b0dc-b04d8d3da593-kube-api-access-xts82\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.818763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.818695    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tmp-dir\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.818763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.818733    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-home\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.818763 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.818760    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tls-certs\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.819050 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.819026    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-model-cache\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.819123 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.819100    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tmp-dir\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.819233 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.819213    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-home\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.820841 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.820822    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-dshm\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.821148 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.821132    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tls-certs\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.880067 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.880033    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xts82\" (UniqueName: \"kubernetes.io/projected/058a1cb2-3d68-438b-b0dc-b04d8d3da593-kube-api-access-xts82\") pod \"premium-w0-162191-kserve-5868cd8954-rcktr\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") " pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:06.976143 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:06.976046    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:07.309542 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:07.309437    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:07.373288 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:07.371676    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"]
Nov 01 03:56:07.393919 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:56:07.393857    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod058a1cb2_3d68_438b_b0dc_b04d8d3da593.slice/crio-5531932a1301c0ab5b7a43af4c99317803150f4da827558b1ef4053ee17b3ae0 WatchSource:0}: Error finding container 5531932a1301c0ab5b7a43af4c99317803150f4da827558b1ef4053ee17b3ae0: Status 404 returned error can't find the container with id 5531932a1301c0ab5b7a43af4c99317803150f4da827558b1ef4053ee17b3ae0
Nov 01 03:56:07.849083 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:07.849047    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" event={"ID":"058a1cb2-3d68-438b-b0dc-b04d8d3da593","Type":"ContainerStarted","Data":"2ce6f498f26211e5ea31d6cd483789cf6f6ca84ebf5b4cfceecb97831a99f617"}
Nov 01 03:56:07.849506 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:07.849094    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" event={"ID":"058a1cb2-3d68-438b-b0dc-b04d8d3da593","Type":"ContainerStarted","Data":"5531932a1301c0ab5b7a43af4c99317803150f4da827558b1ef4053ee17b3ae0"}
Nov 01 03:56:07.967903 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:07.967850    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" podStartSLOduration=1.96783382 podStartE2EDuration="1.96783382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:56:07.966688592 +0000 UTC m=+788.726416388" watchObservedRunningTime="2026-11-01 03:56:07.96783382 +0000 UTC m=+788.727561615"
Nov 01 03:56:07.976701 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:07.976672    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:12.239944 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:12.239907    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:14.283338 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:56:14.283300    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:56:16.976768 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:16.976730    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:16.989947 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:16.989917    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:17.205422 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:17.205389    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:17.918115 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:17.918085    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 03:56:22.206387 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:22.206336    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:24.554948 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:24.554910    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:27.178321 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:27.178285    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:29.581122 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.581089    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"]
Nov 01 03:56:29.585059 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.585040    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.643177 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.643124    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"]
Nov 01 03:56:29.687229 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.687201    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-f73b9f\"/\"openshift-service-ca.crt\""
Nov 01 03:56:29.687229 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.687207    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-f73b9f\"/\"kube-root-ca.crt\""
Nov 01 03:56:29.687532 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.687516    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f73b9f\"/\"default-dockercfg-qwscg\""
Nov 01 03:56:29.687590 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.687567    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-f73b9f\"/\"premium-w3-f73b9f-kserve-self-signed-certs\""
Nov 01 03:56:29.715559 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.715523    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:29.764210 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.764180    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-dshm\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.764210 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.764214    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-model-cache\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.764416 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.764303    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24jzn\" (UniqueName: \"kubernetes.io/projected/98b47b0c-be85-4d9c-b357-81b50aacbacb-kube-api-access-24jzn\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.764416 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.764352    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-home\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.764416 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.764383    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98b47b0c-be85-4d9c-b357-81b50aacbacb-tls-certs\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.764416 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.764404    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-tmp-dir\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.865893 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.865797    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-dshm\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.865893 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.865857    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-model-cache\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.866135 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.865917    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24jzn\" (UniqueName: \"kubernetes.io/projected/98b47b0c-be85-4d9c-b357-81b50aacbacb-kube-api-access-24jzn\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.866135 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.865962    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-home\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.866135 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.866091    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98b47b0c-be85-4d9c-b357-81b50aacbacb-tls-certs\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.866463 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.866440    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-home\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.866540 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.866465    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-tmp-dir\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.866540 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.866121    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-tmp-dir\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.866742 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.866715    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-model-cache\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.868458 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.868429    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-dshm\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.869100 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.869078    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98b47b0c-be85-4d9c-b357-81b50aacbacb-tls-certs\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:29.927473 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:29.927442    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24jzn\" (UniqueName: \"kubernetes.io/projected/98b47b0c-be85-4d9c-b357-81b50aacbacb-kube-api-access-24jzn\") pod \"premium-w3-f73b9f-kserve-877875bb4-c86xb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") " pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:30.199477 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:30.199434    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:30.583463 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:30.583437    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"]
Nov 01 03:56:30.585658 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:56:30.585630    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98b47b0c_be85_4d9c_b357_81b50aacbacb.slice/crio-1c6f6ac7545335ff5b32cf45d90bbd076a5b1bc32e73cbfbe821becc6d0f9c77 WatchSource:0}: Error finding container 1c6f6ac7545335ff5b32cf45d90bbd076a5b1bc32e73cbfbe821becc6d0f9c77: Status 404 returned error can't find the container with id 1c6f6ac7545335ff5b32cf45d90bbd076a5b1bc32e73cbfbe821becc6d0f9c77
Nov 01 03:56:30.988903 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:30.988854    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" event={"ID":"98b47b0c-be85-4d9c-b357-81b50aacbacb","Type":"ContainerStarted","Data":"df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435"}
Nov 01 03:56:30.989211 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:30.988942    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" event={"ID":"98b47b0c-be85-4d9c-b357-81b50aacbacb","Type":"ContainerStarted","Data":"1c6f6ac7545335ff5b32cf45d90bbd076a5b1bc32e73cbfbe821becc6d0f9c77"}
Nov 01 03:56:31.108038 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:31.107980    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" podStartSLOduration=2.107963945 podStartE2EDuration="2.107963945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:56:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:56:31.106078353 +0000 UTC m=+811.865806153" watchObservedRunningTime="2026-11-01 03:56:31.107963945 +0000 UTC m=+811.867691740"
Nov 01 03:56:31.200255 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:31.200215    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:32.202125 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:32.202085    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:37.198213 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:37.198149    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:40.200467 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:40.200383    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:40.214209 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:40.214180    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:41.057135 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:41.057107    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 03:56:42.211385 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:42.211347    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:43.975625 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:43.975592    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:44.284960 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:56:44.284880    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:56:47.319002 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:47.318901    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:52.322568 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:52.322533    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:56:57.312729 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:56:57.312696    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:02.325007 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:02.324970    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:05.380647 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:05.380609    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:07.307970 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:07.307934    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:11.598303 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.598267    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"]
Nov 01 03:57:11.602443 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.602421    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.656606 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.656577    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"]
Nov 01 03:57:11.688974 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.688942    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-model-cache\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.689191 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.688980    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tls-certs\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.689191 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.689137    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-home\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.689299 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.689209    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-dshm\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.689299 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.689266    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f72s7\" (UniqueName: \"kubernetes.io/projected/f12a8a8a-d0d8-4753-a64d-b005d2d10943-kube-api-access-f72s7\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.689401 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.689316    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tmp-dir\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.704236 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.704208    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-c2c259\"/\"openshift-service-ca.crt\""
Nov 01 03:57:11.704391 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.704236    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-c2c259\"/\"kube-root-ca.crt\""
Nov 01 03:57:11.707599 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.707578    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-c2c259\"/\"premium-w1-c2c259-kserve-self-signed-certs\""
Nov 01 03:57:11.707710 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.707632    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-c2c259\"/\"default-dockercfg-pfmj4\""
Nov 01 03:57:11.734062 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.734026    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:11.791825 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.791796    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-model-cache\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.792015 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.791832    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tls-certs\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.792015 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.791866    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-home\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.792015 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.791897    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-dshm\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.792015 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.791929    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f72s7\" (UniqueName: \"kubernetes.io/projected/f12a8a8a-d0d8-4753-a64d-b005d2d10943-kube-api-access-f72s7\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.792015 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.791964    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tmp-dir\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.792334 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.792297    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-model-cache\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.792392 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.792338    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-home\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.792392 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.792375    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tmp-dir\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.794321 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.794298    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-dshm\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.794621 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.794602    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tls-certs\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.856683 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.856606    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f72s7\" (UniqueName: \"kubernetes.io/projected/f12a8a8a-d0d8-4753-a64d-b005d2d10943-kube-api-access-f72s7\") pod \"premium-w1-c2c259-kserve-bf847b7f9-9clhl\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") " pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:11.915039 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:11.914999    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:12.298836 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:12.298780    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"]
Nov 01 03:57:12.301417 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:57:12.301383    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf12a8a8a_d0d8_4753_a64d_b005d2d10943.slice/crio-412e23e6054544c212225791c118c3c02b12ff5b776f701c9471f0b37b1c1480 WatchSource:0}: Error finding container 412e23e6054544c212225791c118c3c02b12ff5b776f701c9471f0b37b1c1480: Status 404 returned error can't find the container with id 412e23e6054544c212225791c118c3c02b12ff5b776f701c9471f0b37b1c1480
Nov 01 03:57:12.318492 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:12.318460    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:13.256593 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:13.256559    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" event={"ID":"f12a8a8a-d0d8-4753-a64d-b005d2d10943","Type":"ContainerStarted","Data":"42fe357b626d071e52c286af792c6161dda5151907f06b2ea5e8e07300e95c0e"}
Nov 01 03:57:13.256593 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:13.256600    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" event={"ID":"f12a8a8a-d0d8-4753-a64d-b005d2d10943","Type":"ContainerStarted","Data":"412e23e6054544c212225791c118c3c02b12ff5b776f701c9471f0b37b1c1480"}
Nov 01 03:57:13.374711 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:13.374660    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" podStartSLOduration=2.3746464879999998 podStartE2EDuration="2.374646488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:57:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:57:13.374528163 +0000 UTC m=+854.134255951" watchObservedRunningTime="2026-11-01 03:57:13.374646488 +0000 UTC m=+854.134374283"
Nov 01 03:57:13.915353 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:13.915319    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:14.284785 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:57:14.284701    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:57:17.357796 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:17.357755    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:21.916073 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:21.916035    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:21.929010 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:21.928983    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:22.318081 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:22.318002    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:22.325015 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:22.324988    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 03:57:27.318419 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:27.318385    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:27.523493 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:27.523454    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:32.316618 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:32.316582    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:37.237460 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:37.237418    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:42.220236 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:42.220201    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:44.285736 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:57:44.285696    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:57:47.224445 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:47.224356    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:52.220548 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:52.220507    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:57.201394 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:57.201354    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:57:59.498905 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:59.498877    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:57:59.501382 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:57:59.501357    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 03:58:02.207580 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:02.207529    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:05.814485 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:05.814446    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:07.196713 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:07.196674    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:09.275321 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:09.275226    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:09.467703 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:09.467667    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:09.662728 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:09.662696    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:12.220374 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:12.220343    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:14.285059 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:58:14.285024    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:58:15.458843 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:15.458799    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:16.009900 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:16.009861    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:17.220912 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:17.220878    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:22.192560 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:22.192522    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:26.292116 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:26.292081    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:27.123954 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:27.123922    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:32.220800 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.220762    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:32.789879 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.789843    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"]
Nov 01 03:58:32.793734 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.793709    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.848670 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.848636    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-f73b9f-openshift-default-dockercfg-rtg6h\""
Nov 01 03:58:32.851752 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.851650    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"]
Nov 01 03:58:32.905746 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.905714    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.905915 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.905754    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c4b0a70-b431-4cb0-9748-93def341c4ca-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.905915 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.905781    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.905990 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.905922    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhd7k\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-kube-api-access-vhd7k\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.906025 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.906015    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.906063 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.906034    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.906096 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.906060    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.906096 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.906083    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:32.906158 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:32.906132    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007410 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007375    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhd7k\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-kube-api-access-vhd7k\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007441    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007463    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007477    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007499    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007514    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007594 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007574    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007977 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007630    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c4b0a70-b431-4cb0-9748-93def341c4ca-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007977 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007656    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.007977 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.007951    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.008116 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.008015    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.008215 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.008134    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.008290 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.008268    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.008436 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.008418    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c4b0a70-b431-4cb0-9748-93def341c4ca-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.009805 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.009779    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.010100 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.010081    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.069415 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.069343    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.069415 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.069384    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhd7k\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-kube-api-access-vhd7k\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.107284 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.107249    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:33.541865 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.541841    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"]
Nov 01 03:58:33.543945 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:58:33.543917    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4b0a70_b431_4cb0_9748_93def341c4ca.slice/crio-22588742688d33b789aedf768f0ce41f5c47757e2befe9666aa3bcaa22d3aa8b WatchSource:0}: Error finding container 22588742688d33b789aedf768f0ce41f5c47757e2befe9666aa3bcaa22d3aa8b: Status 404 returned error can't find the container with id 22588742688d33b789aedf768f0ce41f5c47757e2befe9666aa3bcaa22d3aa8b
Nov 01 03:58:33.546104 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.546070    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:33.546212 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.546184    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:33.546263 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.546220    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:33.754899 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.754865    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" event={"ID":"8c4b0a70-b431-4cb0-9748-93def341c4ca","Type":"ContainerStarted","Data":"16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68"}
Nov 01 03:58:33.755094 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.754925    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" event={"ID":"8c4b0a70-b431-4cb0-9748-93def341c4ca","Type":"ContainerStarted","Data":"22588742688d33b789aedf768f0ce41f5c47757e2befe9666aa3bcaa22d3aa8b"}
Nov 01 03:58:33.878018 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:33.877967    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podStartSLOduration=1.8779519279999999 podStartE2EDuration="1.877951928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:58:33.876047372 +0000 UTC m=+934.635775167" watchObservedRunningTime="2026-11-01 03:58:33.877951928 +0000 UTC m=+934.637679794"
Nov 01 03:58:34.107971 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:34.107935    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:34.109634 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:34.109606    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 01 03:58:34.109783 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:34.109663    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 01 03:58:35.108428 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:35.108395    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 01 03:58:35.108921 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:35.108448    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 01 03:58:36.108364 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:36.108330    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 01 03:58:36.108556 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:36.108402    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 01 03:58:37.108584 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:37.108552    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 01 03:58:37.108978 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:37.108612    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 01 03:58:37.387342 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:37.387310    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:38.108346 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:38.108300    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 01 03:58:38.108554 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:38.108352    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 01 03:58:39.107749 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:39.107708    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 01 03:58:39.108198 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:39.107786    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 01 03:58:40.108245 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.108209    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Nov 01 03:58:40.108708 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.108277    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Nov 01 03:58:40.143361 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.143322    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"]
Nov 01 03:58:40.147434 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.147413    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.211536 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.211503    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.211686 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.211555    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.211686 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.211636    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.211823 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.211698    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.211823 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.211796    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.211923 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.211833    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.211967 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.211944    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.212024 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.211968    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk2cd\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-kube-api-access-xk2cd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.212078 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.212061    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.232574 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.232535    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"]
Nov 01 03:58:40.313038 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.312996    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313297 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313067    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313297 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313201    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313297 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313247    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313297 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313271    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313513 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313365    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313513 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313393    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk2cd\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-kube-api-access-xk2cd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313513 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313460    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313513 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313499    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.313770 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.313749    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.314113 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.314070    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.314234 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.314128    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.314427 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.314406    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.314553 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.314420    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.316438 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.316407    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.316636 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.316615    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.377819 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.377787    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.379870 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.379841    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk2cd\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-kube-api-access-xk2cd\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hq47j\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.463936 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.463901    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:40.899258 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.899231    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"]
Nov 01 03:58:40.902143 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:58:40.902117    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44dfbaba_e6c6_42c1_9370_0af412e38f2f.slice/crio-50189ac9da8756f73fa33ab19808c81012f8586a4342b912eb3bbd440d57ccdc WatchSource:0}: Error finding container 50189ac9da8756f73fa33ab19808c81012f8586a4342b912eb3bbd440d57ccdc: Status 404 returned error can't find the container with id 50189ac9da8756f73fa33ab19808c81012f8586a4342b912eb3bbd440d57ccdc
Nov 01 03:58:40.904359 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.904325    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:40.904462 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.904399    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:40.904462 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:40.904443    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:41.112139 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:41.112104    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:41.112632 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:41.112416    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:41.113270 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:41.113252    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 03:58:41.806393 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:41.806355    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" event={"ID":"44dfbaba-e6c6-42c1-9370-0af412e38f2f","Type":"ContainerStarted","Data":"dc0bf10d9e9931eebe0ec0c6b0f19cdfaa650cc2ac844951eef110bfdcf6111a"}
Nov 01 03:58:41.806564 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:41.806421    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" event={"ID":"44dfbaba-e6c6-42c1-9370-0af412e38f2f","Type":"ContainerStarted","Data":"50189ac9da8756f73fa33ab19808c81012f8586a4342b912eb3bbd440d57ccdc"}
Nov 01 03:58:41.938189 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:41.937204    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podStartSLOduration=1.9371842419999998 podStartE2EDuration="1.937184242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:58:41.936552292 +0000 UTC m=+942.696280088" watchObservedRunningTime="2026-11-01 03:58:41.937184242 +0000 UTC m=+942.696912035"
Nov 01 03:58:42.451690 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:42.451629    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:42.464183 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:42.464127    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:42.465744 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:42.465723    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hq47j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 01 03:58:42.465853 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:42.465783    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 01 03:58:43.464724 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:43.464678    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hq47j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 01 03:58:43.465123 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:43.464748    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 01 03:58:44.283642 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:58:44.283602    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:58:44.464348 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:44.464311    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hq47j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 01 03:58:44.464523 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:44.464377    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 01 03:58:45.465230 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:45.465186    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hq47j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 01 03:58:45.465655 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:45.465250    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 01 03:58:46.465184 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:46.465136    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hq47j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 01 03:58:46.465405 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:46.465380    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 01 03:58:47.464606 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:47.464567    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hq47j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 01 03:58:47.464824 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:47.464633    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 01 03:58:47.549652 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:47.549616    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:48.465317 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:48.465276    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hq47j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Nov 01 03:58:48.465541 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:48.465345    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Nov 01 03:58:49.469371 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:49.469345    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:49.469790 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:49.469770    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:49.470552 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:49.470534    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 03:58:52.611479 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:52.611439    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:55.261045 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.261015    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"]
Nov 01 03:58:55.264986 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.264966    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.381302 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.381261    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"]
Nov 01 03:58:55.393958 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.393928    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.394117 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.393988    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.394117 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.394072    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vmnv\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-kube-api-access-8vmnv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.394232 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.394125    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.394232 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.394191    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.394232 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.394218    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.394363 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.394304    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.394363 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.394332    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.394465 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.394441    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495122 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495084    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495122 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495127    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmnv\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-kube-api-access-8vmnv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495402 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495197    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495402 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495251    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495402 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495285    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495570 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495450    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495570 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495511    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495680 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495564    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495680 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495667    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495786 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495699    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495853 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495821    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-data\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495908 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495860    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-credential-socket\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.495980 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.495953    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.496037 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.496000    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-certs\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.497528 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.497509    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.497984 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.497966    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.556814 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.556738    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-token\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.556983 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.556959    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vmnv\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-kube-api-access-8vmnv\") pod \"maas-default-gateway-openshift-default-5df48fcc99-hdk28\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:55.578755 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:55.578723    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:56.018371 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:56.018341    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"]
Nov 01 03:58:56.020239 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:58:56.020208    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49f3a8c_500e_45a7_bbdd_dc0816028af4.slice/crio-c2f948dc1af020bb85dd502ef04658f92b0001d60cacfeebd91b629605b6cbcc WatchSource:0}: Error finding container c2f948dc1af020bb85dd502ef04658f92b0001d60cacfeebd91b629605b6cbcc: Status 404 returned error can't find the container with id c2f948dc1af020bb85dd502ef04658f92b0001d60cacfeebd91b629605b6cbcc
Nov 01 03:58:56.023552 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:56.023510    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:56.023620 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:56.023606    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:56.023659 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:56.023644    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 03:58:56.949187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:56.941872    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" event={"ID":"b49f3a8c-500e-45a7-bbdd-dc0816028af4","Type":"ContainerStarted","Data":"3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9"}
Nov 01 03:58:56.949187 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:56.941942    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" event={"ID":"b49f3a8c-500e-45a7-bbdd-dc0816028af4","Type":"ContainerStarted","Data":"c2f948dc1af020bb85dd502ef04658f92b0001d60cacfeebd91b629605b6cbcc"}
Nov 01 03:58:57.579439 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:57.579402    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:58:57.580988 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:57.580960    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hdk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 01 03:58:57.581120 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:57.581012    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 01 03:58:57.652259 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:57.652137    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:58:58.579375 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:58.579337    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hdk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 01 03:58:58.579774 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:58.579406    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 01 03:58:59.580136 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:59.580103    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hdk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 01 03:58:59.580583 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:58:59.580185    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 01 03:59:00.579372 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:00.579335    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hdk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 01 03:59:00.579547 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:00.579395    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 01 03:59:01.579469 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:01.579430    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hdk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 01 03:59:01.579862 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:01.579498    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 01 03:59:02.579130 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:02.579098    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hdk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 01 03:59:02.579360 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:02.579191    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 01 03:59:02.734764 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:02.734723    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:03.579816 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:03.579777    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hdk28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Nov 01 03:59:03.580089 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:03.579844    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Nov 01 03:59:04.583728 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:04.583697    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:59:04.584132 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:04.584113    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:59:04.584913 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:04.584891    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 03:59:04.806495 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:04.806433    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podStartSLOduration=9.80641191 podStartE2EDuration="9.80641191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:58:57.123847125 +0000 UTC m=+957.883574933" watchObservedRunningTime="2026-11-01 03:59:04.80641191 +0000 UTC m=+965.566139708"
Nov 01 03:59:06.073351 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.073311    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"]
Nov 01 03:59:06.078232 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.078214    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.106317 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.106277    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:06.132846 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.132813    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"]
Nov 01 03:59:06.178959 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.178931    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-c2c259\"/\"distinct-w1-c2c259-kserve-self-signed-certs\""
Nov 01 03:59:06.240010 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.239967    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f56100d9-ce5d-4755-bf06-5911d7d0d221-tls-certs\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.240210 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.240087    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-tmp-dir\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.240210 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.240182    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-model-cache\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.240315 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.240286    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjd6\" (UniqueName: \"kubernetes.io/projected/f56100d9-ce5d-4755-bf06-5911d7d0d221-kube-api-access-7hjd6\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.240367 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.240342    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-home\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.240489 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.240467    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-dshm\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.314952 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.314504    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:06.341644 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.341547    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-dshm\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.341644 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.341606    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f56100d9-ce5d-4755-bf06-5911d7d0d221-tls-certs\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.341887 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.341666    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-tmp-dir\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.341887 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.341740    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-model-cache\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.341887 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.341788    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjd6\" (UniqueName: \"kubernetes.io/projected/f56100d9-ce5d-4755-bf06-5911d7d0d221-kube-api-access-7hjd6\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.341887 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.341831    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-home\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.342278 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.342248    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-home\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.342591 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.342521    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-model-cache\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.343349 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.343324    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-tmp-dir\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.344559 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.344519    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-dshm\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.344935 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.344918    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f56100d9-ce5d-4755-bf06-5911d7d0d221-tls-certs\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.404734 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.404692    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjd6\" (UniqueName: \"kubernetes.io/projected/f56100d9-ce5d-4755-bf06-5911d7d0d221-kube-api-access-7hjd6\") pod \"distinct-w1-c2c259-kserve-b65c8fc86-jf4fz\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:06.690701 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:06.690666    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:07.074487 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:07.074453    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"]
Nov 01 03:59:07.076905 ip-10-0-136-214 kubenswrapper[5529]: W1101 03:59:07.076881    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf56100d9_ce5d_4755_bf06_5911d7d0d221.slice/crio-1fae6495d2655ba326c1ab4a4aa1f81f67a7717a943f659979e893af95c8bc03 WatchSource:0}: Error finding container 1fae6495d2655ba326c1ab4a4aa1f81f67a7717a943f659979e893af95c8bc03: Status 404 returned error can't find the container with id 1fae6495d2655ba326c1ab4a4aa1f81f67a7717a943f659979e893af95c8bc03
Nov 01 03:59:07.720790 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:07.720755    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:08.009489 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:08.009409    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" event={"ID":"f56100d9-ce5d-4755-bf06-5911d7d0d221","Type":"ContainerStarted","Data":"340250e92ad0fac9460c0d93d25e8ddcbc504e3d5aecc91d815afc9fb855d4a4"}
Nov 01 03:59:08.009489 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:08.009450    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" event={"ID":"f56100d9-ce5d-4755-bf06-5911d7d0d221","Type":"ContainerStarted","Data":"1fae6495d2655ba326c1ab4a4aa1f81f67a7717a943f659979e893af95c8bc03"}
Nov 01 03:59:08.129111 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:08.129055    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" podStartSLOduration=2.129039637 podStartE2EDuration="2.129039637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 03:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 03:59:08.126884685 +0000 UTC m=+968.886612480" watchObservedRunningTime="2026-11-01 03:59:08.129039637 +0000 UTC m=+968.888767431"
Nov 01 03:59:08.691211 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:08.691181    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:12.693564 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:12.693521    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:14.285137 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:59:14.285089    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:59:16.359073 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:16.359036    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:16.691252 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:16.691214    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:16.703983 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:16.703958    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:17.090799 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:17.090720    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 03:59:17.626561 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:17.626524    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:20.788609 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:20.788572    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:22.599733 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:22.599699    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:27.615836 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:27.615799    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:28.767527 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:28.767492    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:32.595113 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:32.595066    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:36.222730 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:36.222694    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:37.544049 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:37.544015    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:42.486243 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:42.486201    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:44.298625 ip-10-0-136-214 kubenswrapper[5529]: E1101 03:59:44.298578    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 03:59:46.703310 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:46.703265    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-cxmt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 03:59:46.703786 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:46.703335    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 03:59:47.625714 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:47.625666    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:52.549765 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:52.549722    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:56.391822 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:56.391768    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:56.589999 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:56.589967    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:56.787294 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:56.787160    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 03:59:57.524866 ip-10-0-136-214 kubenswrapper[5529]: I1101 03:59:57.524825    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:00.207004 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.206965    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"]
Nov 01 04:00:00.211094 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.211072    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:00.264581 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.264543    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvfv\" (UniqueName: \"kubernetes.io/projected/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-kube-api-access-vnvfv\") pod \"maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78\" (UID: \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:00.264746 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.264613    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78\" (UID: \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:00.316584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.316546    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"]
Nov 01 04:00:00.362176 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.362124    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6ggdg\""
Nov 01 04:00:00.365679 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.365648    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvfv\" (UniqueName: \"kubernetes.io/projected/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-kube-api-access-vnvfv\") pod \"maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78\" (UID: \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:00.365824 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.365712    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78\" (UID: \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:00.366336 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.366316    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78\" (UID: \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:00.428802 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.428766    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvfv\" (UniqueName: \"kubernetes.io/projected/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-kube-api-access-vnvfv\") pod \"maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78\" (UID: \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:00.526952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.526866    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:00.913286 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.913252    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"]
Nov 01 04:00:00.919114 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:00:00.918087    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e6a245_e053_40e8_9dc2_c57ecb2d7a14.slice/crio-abe6c6c3888333a69ca9fd7f920ecabcfd4ac06002de3f742f4459d8afdb5da9 WatchSource:0}: Error finding container abe6c6c3888333a69ca9fd7f920ecabcfd4ac06002de3f742f4459d8afdb5da9: Status 404 returned error can't find the container with id abe6c6c3888333a69ca9fd7f920ecabcfd4ac06002de3f742f4459d8afdb5da9
Nov 01 04:00:00.920896 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:00.920874    5529 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 04:00:01.400029 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:01.399989    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" event={"ID":"06e6a245-e053-40e8-9dc2-c57ecb2d7a14","Type":"ContainerStarted","Data":"abe6c6c3888333a69ca9fd7f920ecabcfd4ac06002de3f742f4459d8afdb5da9"}
Nov 01 04:00:02.608854 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:02.608821    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:05.518188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:05.517297    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hq47j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 04:00:05.518188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:05.517378    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:00:05.628469 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:05.628310    5529 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-5df48fcc99-hdk28 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 04:00:05.628469 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:05.628380    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:00:06.459691 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:06.459653    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:07.831892 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:07.831828    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:09.516494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:09.516450    5529 generic.go:356] "Generic (PLEG): container finished" podID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerID="c798db439cb14a0e9333ba65b8f01257414e8141c5528e0ba8553ad54ec84b74" exitCode=60
Nov 01 04:00:09.516984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:09.516528    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" event={"ID":"06e6a245-e053-40e8-9dc2-c57ecb2d7a14","Type":"ContainerDied","Data":"c798db439cb14a0e9333ba65b8f01257414e8141c5528e0ba8553ad54ec84b74"}
Nov 01 04:00:09.517584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:09.517560    5529 scope.go:122] "RemoveContainer" containerID="c798db439cb14a0e9333ba65b8f01257414e8141c5528e0ba8553ad54ec84b74"
Nov 01 04:00:10.524689 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:10.524654    5529 generic.go:356] "Generic (PLEG): container finished" podID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerID="6afbe2fad71e507e83df2d8ec9b969edfde6b4e9093b7a6210968d502be6f49c" exitCode=60
Nov 01 04:00:10.525136 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:10.524711    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" event={"ID":"06e6a245-e053-40e8-9dc2-c57ecb2d7a14","Type":"ContainerDied","Data":"6afbe2fad71e507e83df2d8ec9b969edfde6b4e9093b7a6210968d502be6f49c"}
Nov 01 04:00:10.525136 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:10.524766    5529 scope.go:122] "RemoveContainer" containerID="c798db439cb14a0e9333ba65b8f01257414e8141c5528e0ba8553ad54ec84b74"
Nov 01 04:00:10.525136 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:10.525038    5529 scope.go:122] "RemoveContainer" containerID="6afbe2fad71e507e83df2d8ec9b969edfde6b4e9093b7a6210968d502be6f49c"
Nov 01 04:00:10.525371 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:00:10.525346    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78_odh-ai-gateway-infra(06e6a245-e053-40e8-9dc2-c57ecb2d7a14)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14"
Nov 01 04:00:11.533017 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:11.532991    5529 scope.go:122] "RemoveContainer" containerID="6afbe2fad71e507e83df2d8ec9b969edfde6b4e9093b7a6210968d502be6f49c"
Nov 01 04:00:11.533431 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:00:11.533324    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78_odh-ai-gateway-infra(06e6a245-e053-40e8-9dc2-c57ecb2d7a14)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14"
Nov 01 04:00:12.696806 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.696769    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"]
Nov 01 04:00:12.701776 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.701751    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.759178 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.759128    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"]
Nov 01 04:00:12.769991 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.769962    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-c2c259\"/\"distinct-2-w1-c2c259-kserve-self-signed-certs\""
Nov 01 04:00:12.833694 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.833655    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:12.854481 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.854443    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mlg2\" (UniqueName: \"kubernetes.io/projected/9ece915b-a3f4-4895-a369-f92415229cde-kube-api-access-2mlg2\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.854692 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.854546    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ece915b-a3f4-4895-a369-f92415229cde-tls-certs\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.854692 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.854628    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-home\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.854819 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.854775    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-tmp-dir\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.854874 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.854864    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-dshm\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.854947 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.854929    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-model-cache\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.956338 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956237    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-tmp-dir\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.956338 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956304    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-dshm\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.956567 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956383    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-model-cache\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.956567 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956419    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mlg2\" (UniqueName: \"kubernetes.io/projected/9ece915b-a3f4-4895-a369-f92415229cde-kube-api-access-2mlg2\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.956567 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956472    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ece915b-a3f4-4895-a369-f92415229cde-tls-certs\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.956567 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956550    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-home\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.956780 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956720    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-tmp-dir\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.956935 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956907    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-home\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.957016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.956993    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-model-cache\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.959180 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.959144    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-dshm\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:12.959714 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:12.959690    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ece915b-a3f4-4895-a369-f92415229cde-tls-certs\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:13.019248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:13.019209    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mlg2\" (UniqueName: \"kubernetes.io/projected/9ece915b-a3f4-4895-a369-f92415229cde-kube-api-access-2mlg2\") pod \"distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") " pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:13.314659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:13.314549    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:13.699349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:13.699326    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"]
Nov 01 04:00:13.701677 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:00:13.701649    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ece915b_a3f4_4895_a369_f92415229cde.slice/crio-75e52aa405bd8d848b91b5965d09f6b4c483265efe393a58a5c37bcda57ea9a8 WatchSource:0}: Error finding container 75e52aa405bd8d848b91b5965d09f6b4c483265efe393a58a5c37bcda57ea9a8: Status 404 returned error can't find the container with id 75e52aa405bd8d848b91b5965d09f6b4c483265efe393a58a5c37bcda57ea9a8
Nov 01 04:00:14.284431 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:00:14.284386    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:00:14.552544 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:14.552454    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" event={"ID":"9ece915b-a3f4-4895-a369-f92415229cde","Type":"ContainerStarted","Data":"5c846883cf921fead62dc3a5d382b79e76d575ad5aef2112fa409ae8d997f2b5"}
Nov 01 04:00:14.552544 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:14.552506    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" event={"ID":"9ece915b-a3f4-4895-a369-f92415229cde","Type":"ContainerStarted","Data":"75e52aa405bd8d848b91b5965d09f6b4c483265efe393a58a5c37bcda57ea9a8"}
Nov 01 04:00:14.672618 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:14.672554    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" podStartSLOduration=2.672538872 podStartE2EDuration="2.672538872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:00:14.670125662 +0000 UTC m=+1035.429853456" watchObservedRunningTime="2026-11-01 04:00:14.672538872 +0000 UTC m=+1035.432266667"
Nov 01 04:00:15.315019 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:15.314977    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:16.694791 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:16.694748    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:17.812569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:17.812527    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:18.605207 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.605150    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"]
Nov 01 04:00:18.611845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.611813    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617129 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617097    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617286 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617139    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617427 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617303    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617427 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617390    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617537 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617437    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617615    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mn52\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-kube-api-access-4mn52\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617656    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617689    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.617813 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.617776    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.718220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.718180    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"]
Nov 01 04:00:18.718617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.718591    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mn52\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-kube-api-access-4mn52\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.718724 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.718630    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.718802 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.718773    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.718866 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.718831    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.718930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.718904    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.718986 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.718932    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.719038 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.719003    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.719092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.719060    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.719358 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.719331    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.719479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.719378    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.719479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.719432    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.719602 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.719555    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.719781 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.719744    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.719865 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.719799    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.721404 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.721382    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.721576 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.721556    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.780203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.780155    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.780478 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.780448    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mn52\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-kube-api-access-4mn52\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:18.930383 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:18.930343    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:19.370105 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:00:19.370067    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25cd1de7_c5dc_41e8_bdfc_96bfda674b88.slice/crio-aa37fbf64bb5ecd89ceeeebefb193f5c551c2ea1c9e57529283e75fa339b7b1d WatchSource:0}: Error finding container aa37fbf64bb5ecd89ceeeebefb193f5c551c2ea1c9e57529283e75fa339b7b1d: Status 404 returned error can't find the container with id aa37fbf64bb5ecd89ceeeebefb193f5c551c2ea1c9e57529283e75fa339b7b1d
Nov 01 04:00:19.372683 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:19.372645    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:00:19.372794 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:19.372732    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:00:19.372794 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:19.372764    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:00:19.375101 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:19.375084    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"]
Nov 01 04:00:19.587811 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:19.587770    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" event={"ID":"25cd1de7-c5dc-41e8-bdfc-96bfda674b88","Type":"ContainerStarted","Data":"6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4"}
Nov 01 04:00:19.587962 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:19.587836    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" event={"ID":"25cd1de7-c5dc-41e8-bdfc-96bfda674b88","Type":"ContainerStarted","Data":"aa37fbf64bb5ecd89ceeeebefb193f5c551c2ea1c9e57529283e75fa339b7b1d"}
Nov 01 04:00:19.711397 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:19.711325    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podStartSLOduration=1.7113046889999999 podStartE2EDuration="1.711304689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:00:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:00:19.70856298 +0000 UTC m=+1040.468290775" watchObservedRunningTime="2026-11-01 04:00:19.711304689 +0000 UTC m=+1040.471032485"
Nov 01 04:00:19.931315 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:19.930546    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:20.947188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:20.942331    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 01 04:00:20.947188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:20.942445    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 01 04:00:21.938328 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:21.932616    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 01 04:00:21.938328 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:21.932690    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 01 04:00:22.937188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:22.931570    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 01 04:00:22.937188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:22.931639    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 01 04:00:23.318147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:23.317229    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:23.393308 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:23.387026    5529 scope.go:122] "RemoveContainer" containerID="6afbe2fad71e507e83df2d8ec9b969edfde6b4e9093b7a6210968d502be6f49c"
Nov 01 04:00:23.413782 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:23.413743    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:23.934565 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:23.934531    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 01 04:00:23.934860 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:23.934830    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 01 04:00:24.197012 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:24.195555    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:24.224591 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:24.224559    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:00:24.675967 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:24.675904    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" event={"ID":"06e6a245-e053-40e8-9dc2-c57ecb2d7a14","Type":"ContainerStarted","Data":"240912f3f2c2a8fc84620b35180eec68bcdff8a4be472326489b756aaf80707a"}
Nov 01 04:00:24.798635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:24.798548    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" podStartSLOduration=17.616944245 podStartE2EDuration="24.79853448s" totalImagesPullingTime="7.181590235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:00:24.796043872 +0000 UTC m=+1045.555771667" watchObservedRunningTime="2026-11-01 04:00:24.79853448 +0000 UTC m=+1045.558262276"
Nov 01 04:00:24.934243 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:24.933275    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 01 04:00:24.934243 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:24.933341    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 01 04:00:25.685465 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:25.685432    5529 generic.go:356] "Generic (PLEG): container finished" podID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerID="240912f3f2c2a8fc84620b35180eec68bcdff8a4be472326489b756aaf80707a" exitCode=60
Nov 01 04:00:25.685908 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:25.685503    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" event={"ID":"06e6a245-e053-40e8-9dc2-c57ecb2d7a14","Type":"ContainerDied","Data":"240912f3f2c2a8fc84620b35180eec68bcdff8a4be472326489b756aaf80707a"}
Nov 01 04:00:25.685908 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:25.685565    5529 scope.go:122] "RemoveContainer" containerID="6afbe2fad71e507e83df2d8ec9b969edfde6b4e9093b7a6210968d502be6f49c"
Nov 01 04:00:25.686043 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:25.685922    5529 scope.go:122] "RemoveContainer" containerID="240912f3f2c2a8fc84620b35180eec68bcdff8a4be472326489b756aaf80707a"
Nov 01 04:00:25.686282 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:00:25.686254    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78_odh-ai-gateway-infra(06e6a245-e053-40e8-9dc2-c57ecb2d7a14)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14"
Nov 01 04:00:25.825856 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:25.823233    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"]
Nov 01 04:00:25.931112 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:25.931069    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Nov 01 04:00:25.931346 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:25.931149    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Nov 01 04:00:26.865239 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:26.865205    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:26.920155 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:26.920121    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-kube-api-access-vnvfv\" (UniqueName: \"kubernetes.io/projected/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-kube-api-access-vnvfv\") pod \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\" (UID: \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\") "
Nov 01 04:00:26.920354 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:26.920259    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-maas-api-service-ca\") pod \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\" (UID: \"06e6a245-e053-40e8-9dc2-c57ecb2d7a14\") "
Nov 01 04:00:26.920632 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:26.920601    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-maas-api-service-ca" pod "06e6a245-e053-40e8-9dc2-c57ecb2d7a14" (UID: "06e6a245-e053-40e8-9dc2-c57ecb2d7a14"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:00:26.922507 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:26.922472    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-kube-api-access-vnvfv" pod "06e6a245-e053-40e8-9dc2-c57ecb2d7a14" (UID: "06e6a245-e053-40e8-9dc2-c57ecb2d7a14"). InnerVolumeSpecName "kube-api-access-vnvfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:00:27.021593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.021500    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-maas-api-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:00:27.021593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.021545    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnvfv\" (UniqueName: \"kubernetes.io/projected/06e6a245-e053-40e8-9dc2-c57ecb2d7a14-kube-api-access-vnvfv\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:00:27.205778 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.205745    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:27.206965 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.206932    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:27.208030 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.208006    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:00:27.701717 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.701625    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"
Nov 01 04:00:27.701717 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.701658    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78" event={"ID":"06e6a245-e053-40e8-9dc2-c57ecb2d7a14","Type":"ContainerDied","Data":"abe6c6c3888333a69ca9fd7f920ecabcfd4ac06002de3f742f4459d8afdb5da9"}
Nov 01 04:00:27.701946 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.701729    5529 scope.go:122] "RemoveContainer" containerID="240912f3f2c2a8fc84620b35180eec68bcdff8a4be472326489b756aaf80707a"
Nov 01 04:00:27.868844 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.868804    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"]
Nov 01 04:00:27.872831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:27.872802    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-f73b9f-29891760-44q78"]
Nov 01 04:00:28.511006 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:28.510971    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:29.375200 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:29.375146    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" path="/var/lib/kubelet/pods/06e6a245-e053-40e8-9dc2-c57ecb2d7a14/volumes"
Nov 01 04:00:33.562402 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:33.562369    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:36.749898 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:36.749850    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:38.513790 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:38.513755    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:43.437230 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:43.437182    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:44.099603 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.099565    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"]
Nov 01 04:00:44.100125 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.100105    5529 cpu_manager.go:414] "containerMap: removing container" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:00:44.100270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.100126    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:00:44.100270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.100202    5529 cpu_manager.go:414] "containerMap: removing container" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:00:44.100270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.100211    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:00:44.100436 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.100336    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:00:44.100436 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.100350    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:00:44.100436 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.100363    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:00:44.103571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.103550    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.156750 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.156713    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-c2c259-openshift-default-dockercfg-7n2f9\""
Nov 01 04:00:44.210339 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.210308    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"]
Nov 01 04:00:44.213444 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213419    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.213594 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213449    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.213594 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213469    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.213594 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213566    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.213709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213658    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/148fa319-e0e0-4d1a-8958-6d71e0558568-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.213709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213691    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.213796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213712    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8slvj\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-kube-api-access-8slvj\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.213915 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213896    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.213976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.213930    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.283964 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:00:44.283923    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:00:44.314683 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314654    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.314683 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314689    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.314932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314731    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.314932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314748    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.314932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314765    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.314932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314786    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.314932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314829    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/148fa319-e0e0-4d1a-8958-6d71e0558568-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.314932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314872    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.314932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.314905    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8slvj\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-kube-api-access-8slvj\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.315311 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.315222    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.315311 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.315272    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.315423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.315316    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.315564 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.315541    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.315724 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.315703    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/148fa319-e0e0-4d1a-8958-6d71e0558568-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.317339 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.317313    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.317508 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.317491    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.376517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.376484    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.376707 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.376683    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8slvj\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-kube-api-access-8slvj\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.416338 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.416304    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:44.852156 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.852125    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"]
Nov 01 04:00:44.854523 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:00:44.854493    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148fa319_e0e0_4d1a_8958_6d71e0558568.slice/crio-663a733da93eb318da3fd08af5d64d18920112d0764bcf3a80e83e4f86730558 WatchSource:0}: Error finding container 663a733da93eb318da3fd08af5d64d18920112d0764bcf3a80e83e4f86730558: Status 404 returned error can't find the container with id 663a733da93eb318da3fd08af5d64d18920112d0764bcf3a80e83e4f86730558
Nov 01 04:00:44.857059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.857027    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:00:44.857135 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.857093    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:00:44.857135 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:44.857122    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:00:45.837536 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:45.837485    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" event={"ID":"148fa319-e0e0-4d1a-8958-6d71e0558568","Type":"ContainerStarted","Data":"ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c"}
Nov 01 04:00:45.837756 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:45.837591    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" event={"ID":"148fa319-e0e0-4d1a-8958-6d71e0558568","Type":"ContainerStarted","Data":"663a733da93eb318da3fd08af5d64d18920112d0764bcf3a80e83e4f86730558"}
Nov 01 04:00:46.424190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:46.419182    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:46.424190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:46.419311    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 01 04:00:46.424190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:46.419369    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 01 04:00:47.428189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:47.427571    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 01 04:00:47.428189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:47.427633    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 01 04:00:48.427189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:48.426631    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 01 04:00:48.427189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:48.426707    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 01 04:00:48.471723 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:48.471671    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:49.428190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:49.418619    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 01 04:00:49.428190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:49.418682    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 01 04:00:50.426189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:50.424631    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 01 04:00:50.426189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:50.424702    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 01 04:00:51.417375 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:51.417330    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Nov 01 04:00:51.417568 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:51.417416    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Nov 01 04:00:52.421421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:52.421385    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:52.421893 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:52.421870    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:52.422712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:52.422688    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:00:52.595302 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:52.595248    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podStartSLOduration=8.595232733 podStartE2EDuration="8.595232733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:00:46.03534345 +0000 UTC m=+1066.795071245" watchObservedRunningTime="2026-11-01 04:00:52.595232733 +0000 UTC m=+1073.354960528"
Nov 01 04:00:53.607039 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:53.606951    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:56.781755 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:56.781718    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:00:58.539546 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:00:58.539493    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:00.723240 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:00.723206    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:03.608635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:03.608580    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:04.408427 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:04.408391    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:04.602365 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:04.602327    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:06.891834 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:06.891801    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:08.592002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:08.591918    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:09.662194 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:09.662142    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:13.532171 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:13.532136    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:14.284904 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:01:14.284872    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:01:17.062558 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:17.062521    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:18.284496 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:18.284447    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:18.490381 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:18.490352    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:18.689119 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:18.689073    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:23.508017 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:23.507944    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:24.406279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:24.406241    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:24.605639 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:24.605607    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:28.944854 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:28.944812    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:32.701036 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.701000    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"]
Nov 01 04:01:32.701504 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.701490    5529 cpu_manager.go:414] "containerMap: removing container" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:01:32.701504 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.701502    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06e6a245-e053-40e8-9dc2-c57ecb2d7a14" containerName="cleanup"
Nov 01 04:01:32.705294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.705272    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743346 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743310    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743387    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743524 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743426    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743645 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743535    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbt4l\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-kube-api-access-lbt4l\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743645 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743579    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861b2fd5-3a2d-4962-8382-3cade14efe57-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743752 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743692    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743752 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743728    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743759    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.743925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.743865    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.759066 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.759035    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-a9c5b3-openshift-default-dockercfg-88kq5\""
Nov 01 04:01:32.814034 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.813994    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"]
Nov 01 04:01:32.844719 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844686    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.844917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844733    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.844917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844765    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.844917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844789    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.844917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844823    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbt4l\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-kube-api-access-lbt4l\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.844917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844853    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861b2fd5-3a2d-4962-8382-3cade14efe57-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.844917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844892    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.844917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844911    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.845313 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.844930    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.845313 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.845283    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.845479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.845460    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.845552 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.845502    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.845609 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.845567    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.845836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.845818    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861b2fd5-3a2d-4962-8382-3cade14efe57-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.847135 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.847113    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.847436 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.847420    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.906509 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.906470    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:32.906667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:32.906610    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbt4l\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-kube-api-access-lbt4l\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:33.019543 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:33.019471    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:33.455366 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:33.455342    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"]
Nov 01 04:01:33.458501 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:01:33.458471    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861b2fd5_3a2d_4962_8382_3cade14efe57.slice/crio-8f5668101a22c8c16a5bc8e09d9670dbc3429b108d08561bf98e1016f3093ccb WatchSource:0}: Error finding container 8f5668101a22c8c16a5bc8e09d9670dbc3429b108d08561bf98e1016f3093ccb: Status 404 returned error can't find the container with id 8f5668101a22c8c16a5bc8e09d9670dbc3429b108d08561bf98e1016f3093ccb
Nov 01 04:01:33.461278 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:33.461243    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:33.461360 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:33.461313    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:33.461360 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:33.461343    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:33.951188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:33.950137    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:34.144423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.144388    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"]
Nov 01 04:01:34.148147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.148125    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.202026 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.201943    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"]
Nov 01 04:01:34.242184 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.241177    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" event={"ID":"861b2fd5-3a2d-4962-8382-3cade14efe57","Type":"ContainerStarted","Data":"2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead"}
Nov 01 04:01:34.242184 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.241246    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" event={"ID":"861b2fd5-3a2d-4962-8382-3cade14efe57","Type":"ContainerStarted","Data":"8f5668101a22c8c16a5bc8e09d9670dbc3429b108d08561bf98e1016f3093ccb"}
Nov 01 04:01:34.264605 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.264550    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.264797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.264614    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrrl4\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-kube-api-access-jrrl4\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.264797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.264654    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.264969 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.264828    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.265029 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.265007    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.265117 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.265095    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.265277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.265242    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.265360 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.265344    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.266202 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.265575    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.366943 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.366902    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.366965    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.366992    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367043    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367295 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367104    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367295 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367145    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrrl4\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-kube-api-access-jrrl4\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367295 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367194    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367295 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367226    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367500 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367316    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367500 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367423    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-data\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367500 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367436    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-credential-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367868    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-socket\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367889    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-certs\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.367940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.367896    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istiod-ca-cert\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.369549 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.369525    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-podinfo\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.369668 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.369652    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-envoy\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.393566 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.393512    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podStartSLOduration=2.393493984 podStartE2EDuration="2.393493984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:01:34.391489179 +0000 UTC m=+1115.151217001" watchObservedRunningTime="2026-11-01 04:01:34.393493984 +0000 UTC m=+1115.153221782"
Nov 01 04:01:34.436884 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.436846    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-token\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.437101 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.437074    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrrl4\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-kube-api-access-jrrl4\") pod \"e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") " pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.463511 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.463420    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:34.939245 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.934459    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"]
Nov 01 04:01:34.943277 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:01:34.943237    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f7bc02_66fe_43d2_abaf_e5bd85d256ef.slice/crio-ff1d50b4be8d488b7fd90f8f7c00e48b2022fe119372f73573da9bb89078aee9 WatchSource:0}: Error finding container ff1d50b4be8d488b7fd90f8f7c00e48b2022fe119372f73573da9bb89078aee9: Status 404 returned error can't find the container with id ff1d50b4be8d488b7fd90f8f7c00e48b2022fe119372f73573da9bb89078aee9
Nov 01 04:01:34.945766 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.945723    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:34.945873 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.945800    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:34.945873 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:34.945836    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:35.021280 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:35.021197    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:35.025405 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:35.025271    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 01 04:01:35.025405 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:35.025330    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 01 04:01:35.257283 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:35.257153    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" event={"ID":"99f7bc02-66fe-43d2-abaf-e5bd85d256ef","Type":"ContainerStarted","Data":"f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790"}
Nov 01 04:01:35.257283 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:35.257244    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" event={"ID":"99f7bc02-66fe-43d2-abaf-e5bd85d256ef","Type":"ContainerStarted","Data":"ff1d50b4be8d488b7fd90f8f7c00e48b2022fe119372f73573da9bb89078aee9"}
Nov 01 04:01:35.382739 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:35.382682    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" podStartSLOduration=1.382669345 podStartE2EDuration="1.382669345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:01:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:01:35.38227422 +0000 UTC m=+1116.142002014" watchObservedRunningTime="2026-11-01 04:01:35.382669345 +0000 UTC m=+1116.142397139"
Nov 01 04:01:35.463948 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:35.463916    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:36.022617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:36.022578    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 01 04:01:36.023223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:36.023187    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 01 04:01:36.468675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:36.468280    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 01 04:01:36.468675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:36.468366    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 01 04:01:37.026189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:37.021534    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 01 04:01:37.026189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:37.021596    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 01 04:01:37.463977 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:37.463935    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 01 04:01:37.464190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:37.464012    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 01 04:01:38.022637 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:38.022596    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 01 04:01:38.022952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:38.022921    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 01 04:01:38.471184 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:38.470649    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 01 04:01:38.471184 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:38.470715    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 01 04:01:39.024190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:39.023562    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 01 04:01:39.024190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:39.023627    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 01 04:01:39.201283 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:39.201248    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:39.467192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:39.466642    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 01 04:01:39.467192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:39.466711    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 01 04:01:40.024186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:40.021617    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 01 04:01:40.024186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:40.021684    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 01 04:01:40.464061 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:40.464020    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 01 04:01:40.464276 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:40.464079    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 01 04:01:41.047247 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:41.047206    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:41.048287 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:41.048259    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:41.049518 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:41.049498    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:01:41.463979 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:41.463938    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 01 04:01:41.464173 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:41.464002    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 01 04:01:42.468575 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:42.468545    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:42.468981 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:42.468959    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:42.469629 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:42.469609    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:01:44.215243 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.215206    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:44.285626 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:01:44.285588    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:01:44.551133 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.551053    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"]
Nov 01 04:01:44.555713 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.555690    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.602655 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.602622    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"]
Nov 01 04:01:44.606608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.606586    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.637921 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.637881    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.638089 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.638020    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.638089 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.638064    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.638219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.638091    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/614d06dd-0135-4003-99a6-3513d4c71726-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.638219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.638123    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.638294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.638272    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/614d06dd-0135-4003-99a6-3513d4c71726-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.638393 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.638349    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.638452 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.638424    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.638452 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.638442    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn5hd\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-kube-api-access-cn5hd\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.651732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.651704    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"]
Nov 01 04:01:44.737212 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.727539    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"]
Nov 01 04:01:44.748336 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.748298    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.748540 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.748352    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.748540 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.748412    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.748540 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.748448    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.748540 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.748480    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.748540 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.748506    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.748786 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.748542    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749068 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749041    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749358 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749335    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749544 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749515    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/614d06dd-0135-4003-99a6-3513d4c71726-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749607 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749568    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749609    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/614d06dd-0135-4003-99a6-3513d4c71726-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749715 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749664    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.749715 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749670    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749758    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749810    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9aedecf-18d9-4332-ac97-5491bd761f51-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.749946 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749852    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749946 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749879    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn5hd\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-kube-api-access-cn5hd\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.749946 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749917    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2m8z\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-kube-api-access-p2m8z\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.750104 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.749946    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.750104 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.750040    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.751502 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.751470    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/614d06dd-0135-4003-99a6-3513d4c71726-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.751739 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.751718    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.752618 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.752586    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.753078 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.753055    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/614d06dd-0135-4003-99a6-3513d4c71726-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.812953 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.812864    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn5hd\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-kube-api-access-cn5hd\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.813116 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.813006    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.851324 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851289    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.851324 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851328    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.851599 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851397    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.851599 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851461    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9aedecf-18d9-4332-ac97-5491bd761f51-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.851599 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851502    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2m8z\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-kube-api-access-p2m8z\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.851599 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851528    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.851841 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851605    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.851841 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851649    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.851841 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851705    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.852015 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851841    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.852015 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.851899    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-certs\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.852195 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.852147    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-credential-socket\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.852274 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.852253    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-data\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.852342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.852310    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9aedecf-18d9-4332-ac97-5491bd761f51-istiod-ca-cert\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.853968 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.853942    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-envoy\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.854157 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.854137    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-podinfo\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.869830 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.869803    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:44.913303 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.913266    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-token\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.914547 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.913915    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2m8z\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-kube-api-access-p2m8z\") pod \"e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") " pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:44.919901 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:44.919874    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:45.311045 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.311014    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"]
Nov 01 04:01:45.312438 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:01:45.312407    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614d06dd_0135_4003_99a6_3513d4c71726.slice/crio-7f1de829a23ef97311b56bc0b34dcf138380b695e58b9787fc4bf46f0c405d3c WatchSource:0}: Error finding container 7f1de829a23ef97311b56bc0b34dcf138380b695e58b9787fc4bf46f0c405d3c: Status 404 returned error can't find the container with id 7f1de829a23ef97311b56bc0b34dcf138380b695e58b9787fc4bf46f0c405d3c
Nov 01 04:01:45.315993 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.315950    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:45.316102 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.316050    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:45.316102 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.316092    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:45.349154 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.349121    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" event={"ID":"614d06dd-0135-4003-99a6-3513d4c71726","Type":"ContainerStarted","Data":"7f1de829a23ef97311b56bc0b34dcf138380b695e58b9787fc4bf46f0c405d3c"}
Nov 01 04:01:45.364232 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.364200    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"]
Nov 01 04:01:45.372502 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:01:45.372469    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9aedecf_18d9_4332_ac97_5491bd761f51.slice/crio-4495fe38caddf152c439c980af81f241f6aa0fd87988c907d99061f6cc7d77bc WatchSource:0}: Error finding container 4495fe38caddf152c439c980af81f241f6aa0fd87988c907d99061f6cc7d77bc: Status 404 returned error can't find the container with id 4495fe38caddf152c439c980af81f241f6aa0fd87988c907d99061f6cc7d77bc
Nov 01 04:01:45.375683 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.375635    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:45.375790 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.375734    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:45.375790 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:45.375775    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:01:46.373569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.373532    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" event={"ID":"c9aedecf-18d9-4332-ac97-5491bd761f51","Type":"ContainerStarted","Data":"1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8"}
Nov 01 04:01:46.374009 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.373589    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" event={"ID":"c9aedecf-18d9-4332-ac97-5491bd761f51","Type":"ContainerStarted","Data":"4495fe38caddf152c439c980af81f241f6aa0fd87988c907d99061f6cc7d77bc"}
Nov 01 04:01:46.376145 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.376120    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" event={"ID":"614d06dd-0135-4003-99a6-3513d4c71726","Type":"ContainerStarted","Data":"16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57"}
Nov 01 04:01:46.504781 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.504718    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podStartSLOduration=2.504697442 podStartE2EDuration="2.504697442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:01:46.501869391 +0000 UTC m=+1127.261597186" watchObservedRunningTime="2026-11-01 04:01:46.504697442 +0000 UTC m=+1127.264425242"
Nov 01 04:01:46.870543 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.870452    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:46.871834 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.871809    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 01 04:01:46.871907 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.871861    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 01 04:01:46.935270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.934219    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:46.962625 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.962459    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 01 04:01:46.962625 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:46.962533    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 01 04:01:47.872185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:47.871643    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 01 04:01:47.872185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:47.871712    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 01 04:01:47.921189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:47.920633    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 01 04:01:47.921189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:47.920703    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 01 04:01:48.870778 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:48.870731    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 01 04:01:48.871044 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:48.870801    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 01 04:01:48.922201 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:48.921654    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 01 04:01:48.922201 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:48.921721    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 01 04:01:49.465245 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:49.465217    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:49.870353 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:49.870260    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 01 04:01:49.870659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:49.870618    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 01 04:01:49.932191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:49.930149    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 01 04:01:49.932191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:49.930238    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 01 04:01:50.870916 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:50.870878    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 01 04:01:50.871242 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:50.871203    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 01 04:01:50.920795 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:50.920757    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 01 04:01:50.921108 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:50.921078    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 01 04:01:51.871412 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:51.871361    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 01 04:01:51.871940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:51.871456    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 01 04:01:51.920803 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:51.920763    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Nov 01 04:01:51.920986 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:51.920853    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Nov 01 04:01:52.940136 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:52.940100    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:52.941344 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:52.941319    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:52.941943 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:52.941922    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:01:52.961913 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:52.961859    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:52.962339 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:52.962308    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:52.963411 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:52.963390    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:01:53.113602 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:53.113551    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podStartSLOduration=9.113534499 podStartE2EDuration="9.113534499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:01:46.635986793 +0000 UTC m=+1127.395714589" watchObservedRunningTime="2026-11-01 04:01:53.113534499 +0000 UTC m=+1133.873262295"
Nov 01 04:01:54.644048 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:54.644015    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:01:59.847192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:01:59.847141    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:00.053198 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:00.053128    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:03.080976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:03.080936    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:04.927573 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:04.927522    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:07.238337 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:07.238301    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:07.892372 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:07.892331    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:09.979952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:09.979912    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:11.059342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:11.059294    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:02:11.202191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:11.201243    5529 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:02:14.285033 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:02:14.284996    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:02:15.317806 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:15.317757    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:17.412232 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:17.412140    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:18.052552 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.052519    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"]
Nov 01 04:02:18.056723 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.056705    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.163350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.163316    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"]
Nov 01 04:02:18.232612 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.232571    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.232798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.232633    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e73a83-0420-40e0-b911-4c6fba9bb393-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.232798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.232781    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.232952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.232837    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.232952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.232918    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.233068 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.232992    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.233068 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.233053    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-867fx\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-kube-api-access-867fx\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.233204 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.233119    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.233204 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.233148    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334153    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334241    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334258    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334288    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334356    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-867fx\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-kube-api-access-867fx\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334389    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334431    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334765 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334588    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334765 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334653    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334765 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334682    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334765 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334758    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334941 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334800    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e73a83-0420-40e0-b911-4c6fba9bb393-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.334941 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.334804    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.335588 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.335561    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e73a83-0420-40e0-b911-4c6fba9bb393-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.336919 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.336890    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.337219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.337201    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.380690 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.380651    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:18.395446 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.395416    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-867fx\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-kube-api-access-867fx\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.395610 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.395584    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:18.581620 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.581584    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:18.671300 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:18.671255    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:19.107743 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:19.107712    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"]
Nov 01 04:02:19.110959 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:02:19.110930    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e73a83_0420_40e0_b911_4c6fba9bb393.slice/crio-56cfa40dce4e32e265007c08708a7771fab71cf0237391a184edc605021b4d02 WatchSource:0}: Error finding container 56cfa40dce4e32e265007c08708a7771fab71cf0237391a184edc605021b4d02: Status 404 returned error can't find the container with id 56cfa40dce4e32e265007c08708a7771fab71cf0237391a184edc605021b4d02
Nov 01 04:02:19.113500 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:19.113460    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:02:19.113620 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:19.113543    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:02:19.113620 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:19.113589    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:02:19.769890 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:19.769846    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" event={"ID":"d6e73a83-0420-40e0-b911-4c6fba9bb393","Type":"ContainerStarted","Data":"a92319140a45b7b37d3ef95e7b7ca171e08ec3bcc8c7648d36c894d0c8984ae1"}
Nov 01 04:02:19.770325 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:19.769914    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" event={"ID":"d6e73a83-0420-40e0-b911-4c6fba9bb393","Type":"ContainerStarted","Data":"56cfa40dce4e32e265007c08708a7771fab71cf0237391a184edc605021b4d02"}
Nov 01 04:02:19.947001 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:19.946937    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podStartSLOduration=1.946917175 podStartE2EDuration="1.946917175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:02:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:02:19.945034616 +0000 UTC m=+1160.704762412" watchObservedRunningTime="2026-11-01 04:02:19.946917175 +0000 UTC m=+1160.706644971"
Nov 01 04:02:20.465190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:20.461733    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:20.671714 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:20.671676    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:20.673543 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:20.673517    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Nov 01 04:02:20.673685 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:20.673567    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Nov 01 04:02:21.672531 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:21.672484    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Nov 01 04:02:21.672939 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:21.672556    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Nov 01 04:02:22.671638 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:22.671601    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Nov 01 04:02:22.671838 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:22.671670    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Nov 01 04:02:23.672353 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:23.672309    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Nov 01 04:02:23.672792 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:23.672381    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Nov 01 04:02:24.672011 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:24.671973    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Nov 01 04:02:24.672209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:24.672030    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Nov 01 04:02:25.541967 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:25.541923    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:25.671954 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:25.671913    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Nov 01 04:02:25.672128 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:25.671984    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Nov 01 04:02:26.676595 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:26.676564    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:26.677052 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:26.677033    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:26.677671 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:26.677656    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:02:28.360564 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:28.360530    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:28.579480 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:28.579446    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:30.769225 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:30.765802    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:33.189095 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.189064    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"]
Nov 01 04:02:33.194070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.194043    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.280652 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.280610    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdcgf\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-kube-api-access-kdcgf\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.280831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.280686    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.280917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.280887    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.280961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.280950    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.281090 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.281061    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.281128 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.281117    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.281282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.281261    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.281326 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.281299    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.281374 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.281331    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.382705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.382670    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.382967 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.382945    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.383095 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383077    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.383212 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383089    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-credential-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.383212 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383110    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.383212 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383200    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.383379 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383282    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdcgf\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-kube-api-access-kdcgf\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.383379 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383326    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.383491 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383466    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.383549 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383509    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.386662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.383850    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-data\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.386662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.384293    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-certs\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.386662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.385100    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istiod-ca-cert\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.386662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.385871    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-envoy\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.389592 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.389542    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-podinfo\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.389592 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.389567    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-socket\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.393531 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.393463    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"]
Nov 01 04:02:33.445441 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.445352    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-token\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.445603 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.445511    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdcgf\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-kube-api-access-kdcgf\") pod \"e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") " pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.508330 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.508297    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:33.951240 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.951216    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"]
Nov 01 04:02:33.951894 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:02:33.951871    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd194c0c_7c9f_4b6b_a4dc_838cc6b7da93.slice/crio-1e0c07f2b94c48daa63f7e05e18238990f7ea9732e134926abf57b2d67237754 WatchSource:0}: Error finding container 1e0c07f2b94c48daa63f7e05e18238990f7ea9732e134926abf57b2d67237754: Status 404 returned error can't find the container with id 1e0c07f2b94c48daa63f7e05e18238990f7ea9732e134926abf57b2d67237754
Nov 01 04:02:33.954783 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.954748    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:02:33.954890 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.954818    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:02:33.954890 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:33.954847    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:02:34.900302 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:34.900264    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" event={"ID":"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93","Type":"ContainerStarted","Data":"17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003"}
Nov 01 04:02:34.900817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:34.900363    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" event={"ID":"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93","Type":"ContainerStarted","Data":"1e0c07f2b94c48daa63f7e05e18238990f7ea9732e134926abf57b2d67237754"}
Nov 01 04:02:35.071056 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:35.071004    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podStartSLOduration=2.070991153 podStartE2EDuration="2.070991153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:02:35.070464236 +0000 UTC m=+1175.830192031" watchObservedRunningTime="2026-11-01 04:02:35.070991153 +0000 UTC m=+1175.830718948"
Nov 01 04:02:35.508586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:35.508546    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:35.510301 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:35.510269    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 01 04:02:35.510528 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:35.510498    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 01 04:02:35.942021 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:35.941981    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:36.509556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:36.509519    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 01 04:02:36.509714 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:36.509572    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 01 04:02:37.509041 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:37.509002    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 01 04:02:37.509511 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:37.509057    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 01 04:02:38.508910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:38.508871    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 01 04:02:38.509083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:38.508931    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 01 04:02:39.508747 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:39.508709    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 01 04:02:39.508937 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:39.508764    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 01 04:02:40.509348 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:40.509312    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 01 04:02:40.509751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:40.509385    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 01 04:02:41.030358 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:41.030316    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:41.514283 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:41.514252    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:41.514956 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:41.514933    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:41.515851 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:41.515833    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:02:44.283773 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:02:44.283734    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:02:46.028209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:46.028175    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:51.332717 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:51.332681    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:54.409199 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:54.408971    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:56.321951 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:56.321901    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:02:59.546996 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:59.546965    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:02:59.549585 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:02:59.549566    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:03:01.326422 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:01.326390    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:03.921748 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:03.921708    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"]
Nov 01 04:03:03.926088 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:03.926062    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:03.979089 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:03.979055    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-162191-openshift-default-dockercfg-c4j58\""
Nov 01 04:03:04.018084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018046    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndc82\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-kube-api-access-ndc82\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.018313 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018104    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-istio-token\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.018313 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018211    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb0a35-2a45-4325-98ca-d7091991776a-istio-podinfo\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.018313 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018258    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-envoy\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.018313 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018301    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-certs\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.020798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018328    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-socket\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.020798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018349    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-credential-socket\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.020798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018391    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-data\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.020798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.018417    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb0a35-2a45-4325-98ca-d7091991776a-istiod-ca-cert\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.032716 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.032678    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"]
Nov 01 04:03:04.120028 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.119992    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb0a35-2a45-4325-98ca-d7091991776a-istio-podinfo\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120048    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-envoy\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120089    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-certs\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120117    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-socket\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120144    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-credential-socket\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120197    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-data\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120220    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb0a35-2a45-4325-98ca-d7091991776a-istiod-ca-cert\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120587 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120357    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndc82\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-kube-api-access-ndc82\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120587 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120397    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-istio-token\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120587 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120549    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-socket\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.120890 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.120862    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-credential-socket\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.121241 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.121216    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-data\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.121335 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.121254    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-certs\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.121335 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.121320    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb0a35-2a45-4325-98ca-d7091991776a-istiod-ca-cert\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.122681 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.122653    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-envoy\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.123590 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.123567    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb0a35-2a45-4325-98ca-d7091991776a-istio-podinfo\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.181677 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.181609    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-istio-token\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.181677 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.181668    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndc82\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-kube-api-access-ndc82\") pod \"e2e-worker-w0-162191-openshift-default-699bc96769-thrjk\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") " pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.243431 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.243396    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:04.678638 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.678612    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"]
Nov 01 04:03:04.680364 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:03:04.680336    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fb0a35_2a45_4325_98ca_d7091991776a.slice/crio-08b85f43096a3fd8728a18f2c93ca94190e3b3a54f088544954d9d642a8fa67e WatchSource:0}: Error finding container 08b85f43096a3fd8728a18f2c93ca94190e3b3a54f088544954d9d642a8fa67e: Status 404 returned error can't find the container with id 08b85f43096a3fd8728a18f2c93ca94190e3b3a54f088544954d9d642a8fa67e
Nov 01 04:03:04.683472 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.683435    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:03:04.683587 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.683526    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:03:04.683587 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:04.683575    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:03:05.204187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:05.203898    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" event={"ID":"16fb0a35-2a45-4325-98ca-d7091991776a","Type":"ContainerStarted","Data":"cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599"}
Nov 01 04:03:05.204187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:05.203964    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" event={"ID":"16fb0a35-2a45-4325-98ca-d7091991776a","Type":"ContainerStarted","Data":"08b85f43096a3fd8728a18f2c93ca94190e3b3a54f088544954d9d642a8fa67e"}
Nov 01 04:03:05.244147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:05.243941    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:05.245328 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:05.245297    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:05.245505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:05.245350    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:05.372189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:05.351577    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podStartSLOduration=2.351552703 podStartE2EDuration="2.351552703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:03:05.326403487 +0000 UTC m=+1206.086131320" watchObservedRunningTime="2026-11-01 04:03:05.351552703 +0000 UTC m=+1206.111280498"
Nov 01 04:03:06.259223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:06.245640    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:06.259223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:06.245708    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:06.761192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:06.759028    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:06.929188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:06.924656    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:07.058249 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.056258    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:07.081316 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.081262    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Nov 01 04:03:07.203322 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.203270    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" podUID="9ece915b-a3f4-4895-a369-f92415229cde" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:07.245368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.245320    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:07.245672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.245631    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:07.324227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.323772    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 01 04:03:07.630187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.628256    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:07.699263 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.699214    5529 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:07.782305 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.782254    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:07.789545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:07.789511    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:08.039681 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.039556    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": context deadline exceeded"
Nov 01 04:03:08.065762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.052588    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 04:03:08.116123 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.076147    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:08.116450 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.088007    5529 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:08.116602 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.089958    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:08.117014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.116985    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 04:03:08.117128 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.117049    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 04:03:08.235694 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.235645    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" podUID="9ece915b-a3f4-4895-a369-f92415229cde" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:08.259189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.236330    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:03:08.281193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.271267    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:08.281193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.271328    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:08.332405 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.332307    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:08.333448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.333425    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 04:03:08.505857 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.497644    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 04:03:08.505857 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.497708    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:08.636070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.635468    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:08.636070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.635934    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 04:03:08.787330 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.787258    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:08.824272 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:08.806702    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 04:03:09.061486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.061380    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:09.070811 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.070780    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 04:03:09.118349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.118299    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:09.149608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.149465    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 04:03:09.149608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.149531    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:09.250819 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.250397    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" podUID="9ece915b-a3f4-4895-a369-f92415229cde" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": context deadline exceeded"
Nov 01 04:03:09.268216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.252736    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:09.268216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.252783    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:09.382198 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.378594    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded"
Nov 01 04:03:09.676736 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.643342    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:09.755083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.754868    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:09.882253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.843470    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:09.991996 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:09.991630    5529 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:10.065626 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.065589    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main" probeResult="failure" output="Get \"https://10.133.0.54:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:10.087652 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.087606    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 01 04:03:10.123318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.120363    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Nov 01 04:03:10.209889 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.209857    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 04:03:10.261239 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.253667    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" podUID="9ece915b-a3f4-4895-a369-f92415229cde" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:10.282344 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.282285    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:10.282644 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.282602    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:10.462868 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.438035    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:10.660558 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.660530    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 04:03:10.666790 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.666744    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:10.692828 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.692799    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 04:03:10.713220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.709537    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 04:03:10.718349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.717873    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:03:10.803216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.801794    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 04:03:10.881202 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:10.881150    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:11.244818 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:11.244780    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:11.245104 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:11.245070    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:12.245187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:12.244573    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:12.245187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:12.244638    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:13.126041 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:13.125983    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:13.243757 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:13.243723    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:13.243961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:13.243775    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:14.244711 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:14.244669    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 01 04:03:14.245265 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:14.244738    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 01 04:03:14.285941 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:03:14.285900    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:03:15.087671 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:15.087605    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:15.297431 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:15.297397    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:16.245111 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:16.245068    5529 patch_prober.go:29] interesting pod/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 04:03:16.245290 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:16.245201    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:03:16.283511 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:16.283472    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:16.284460 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:16.284434    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:16.285254 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:16.285238    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:03:17.815294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:17.815254    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:18.315993 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:18.315962    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:18.515151 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:18.515094    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:18.743300 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:18.743216    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:21.138460 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:21.138423    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:21.713196 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:21.713144    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:21.976350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:21.976251    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:23.754307 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:23.754254    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:26.018353 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:26.018317    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:26.226309 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:26.226271    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:26.425869 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:26.425836    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:29.018843 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:29.018801    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:29.223275 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:29.223235    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:29.426856 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:29.426821    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:30.132862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.132825    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"]
Nov 01 04:03:30.137918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.137895    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.189871 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.189839    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"]
Nov 01 04:03:30.236583 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.236538    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-865066\"/\"openshift-service-ca.crt\""
Nov 01 04:03:30.236777 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.236607    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-865066\"/\"kube-root-ca.crt\""
Nov 01 04:03:30.240723 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.240699    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-865066\"/\"default-dockercfg-p58bn\""
Nov 01 04:03:30.240876 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.240801    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-865066\"/\"distinct-2-w2-865066-kserve-self-signed-certs\""
Nov 01 04:03:30.245520 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.245491    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-model-cache\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.245667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.245533    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-dshm\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.245667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.245583    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f93737e-433c-4f70-b7e8-179a110cd2b3-tls-certs\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.245667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.245653    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-home\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.245844 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.245745    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5crh\" (UniqueName: \"kubernetes.io/projected/4f93737e-433c-4f70-b7e8-179a110cd2b3-kube-api-access-m5crh\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.245909 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.245858    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-tmp-dir\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.281862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.281823    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:30.346803 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.346771    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-tmp-dir\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.346803 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.346815    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-model-cache\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.347077 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.346838    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-dshm\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.347077 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.346885    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f93737e-433c-4f70-b7e8-179a110cd2b3-tls-certs\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.347077 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.346954    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-home\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.347077 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.347032    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5crh\" (UniqueName: \"kubernetes.io/projected/4f93737e-433c-4f70-b7e8-179a110cd2b3-kube-api-access-m5crh\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.347328 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.347196    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-tmp-dir\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.347328 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.347248    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-model-cache\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.347546 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.347522    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-home\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.349551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.349527    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-dshm\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.349740 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.349720    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f93737e-433c-4f70-b7e8-179a110cd2b3-tls-certs\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.408551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.408483    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5crh\" (UniqueName: \"kubernetes.io/projected/4f93737e-433c-4f70-b7e8-179a110cd2b3-kube-api-access-m5crh\") pod \"distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") " pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.451603 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.451562    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:30.858021 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:30.857990    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"]
Nov 01 04:03:30.859867 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:03:30.859839    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f93737e_433c_4f70_b7e8_179a110cd2b3.slice/crio-8327d05559d4e4965a99c04d5102b931e8d696932e42696f57b09f374e757a98 WatchSource:0}: Error finding container 8327d05559d4e4965a99c04d5102b931e8d696932e42696f57b09f374e757a98: Status 404 returned error can't find the container with id 8327d05559d4e4965a99c04d5102b931e8d696932e42696f57b09f374e757a98
Nov 01 04:03:31.863711 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:31.863673    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt" event={"ID":"4f93737e-433c-4f70-b7e8-179a110cd2b3","Type":"ContainerStarted","Data":"237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1"}
Nov 01 04:03:31.864142 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:31.863725    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt" event={"ID":"4f93737e-433c-4f70-b7e8-179a110cd2b3","Type":"ContainerStarted","Data":"8327d05559d4e4965a99c04d5102b931e8d696932e42696f57b09f374e757a98"}
Nov 01 04:03:31.984534 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:31.984463    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt" podStartSLOduration=1.98444258 podStartE2EDuration="1.98444258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:03:31.983701794 +0000 UTC m=+1232.743429593" watchObservedRunningTime="2026-11-01 04:03:31.98444258 +0000 UTC m=+1232.744170379"
Nov 01 04:03:32.452605 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:32.452563    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:34.689234 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:34.688680    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:35.615378 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:35.615338    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:35.814856 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:35.814823    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:39.825764 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:39.825732    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:40.261959 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:40.261922    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:40.452622 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:40.452587    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:40.465296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:40.465266    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:40.978095 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:40.978059    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:03:44.284995 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:03:44.284961    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:03:44.808552 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:44.808520    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:46.523135 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:46.523098    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:46.819798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:46.819713    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:49.481976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.481942    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"]
Nov 01 04:03:49.486238 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.486211    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.541592 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.541554    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"]
Nov 01 04:03:49.577510 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.577472    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vsj\" (UniqueName: \"kubernetes.io/projected/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-kube-api-access-p9vsj\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.577510 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.577517    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-openshift-service-ca\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.577774 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.577684    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-metrics-certs\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.577838 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.577799    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.587451 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.587425    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-078e0d65-serving-cert\""
Nov 01 04:03:49.680463 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.680426    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-metrics-certs\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.680617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.680578    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.680676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.680658    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vsj\" (UniqueName: \"kubernetes.io/projected/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-kube-api-access-p9vsj\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.680718 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.680704    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-openshift-service-ca\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.681661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.681638    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-openshift-service-ca\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.682093 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:03:49.682052    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-serving-cert: secret "maas-api-e2e-mt-078e0d65-serving-cert" not found
Nov 01 04:03:49.682262 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:03:49.682138    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls podName:9c72ef2b-6af0-44f3-8104-a0758f0b0e03 nodeName:}" failed. No retries permitted until 2026-11-01 04:03:50.182117556 +0000 UTC m=+1250.941845343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls") pod "maas-api-e2e-mt-078e0d65-6588697649-gft22" (UID: "9c72ef2b-6af0-44f3-8104-a0758f0b0e03") : secret "maas-api-e2e-mt-078e0d65-serving-cert" not found
Nov 01 04:03:49.684200 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.684155    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-metrics-certs\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.746240 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.746141    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:49.751579 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.751519    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vsj\" (UniqueName: \"kubernetes.io/projected/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-kube-api-access-p9vsj\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:49.946965 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:49.946931    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:50.188517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:50.188476    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:50.191007 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:50.190980    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls\") pod \"maas-api-e2e-mt-078e0d65-6588697649-gft22\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:50.400141 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:50.400111    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:50.789425 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:50.789394    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"]
Nov 01 04:03:50.792005 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:03:50.791966    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c72ef2b_6af0_44f3_8104_a0758f0b0e03.slice/crio-c45bc4800ab4a460a066985d4d6e90a65fbebb0e4cf0629b683d789b3bbcef97 WatchSource:0}: Error finding container c45bc4800ab4a460a066985d4d6e90a65fbebb0e4cf0629b683d789b3bbcef97: Status 404 returned error can't find the container with id c45bc4800ab4a460a066985d4d6e90a65fbebb0e4cf0629b683d789b3bbcef97
Nov 01 04:03:51.040817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:51.040729    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22" event={"ID":"9c72ef2b-6af0-44f3-8104-a0758f0b0e03","Type":"ContainerStarted","Data":"c45bc4800ab4a460a066985d4d6e90a65fbebb0e4cf0629b683d789b3bbcef97"}
Nov 01 04:03:52.048531 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:52.048450    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22" event={"ID":"9c72ef2b-6af0-44f3-8104-a0758f0b0e03","Type":"ContainerStarted","Data":"a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6"}
Nov 01 04:03:52.048970 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:52.048591    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:03:52.168520 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:52.168463    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22" podStartSLOduration=2.194873887 podStartE2EDuration="3.168446848s" totalImagesPullingTime="973.572961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:03:52.166487274 +0000 UTC m=+1252.926215069" watchObservedRunningTime="2026-11-01 04:03:52.168446848 +0000 UTC m=+1252.928174708"
Nov 01 04:03:54.919737 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:54.919693    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:03:58.061473 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:03:58.061445    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:04:00.040085 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:00.040044    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:04.748323 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:04.748270    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:04.944201 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:04.944136    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:05.150259 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:05.150220    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:05.444209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:05.444075    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:05.672846 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:05.672797    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:08.149569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:08.149491    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:08.358269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:08.358237    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:09.541889 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:09.541836    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:09.756786 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:09.756749    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:10.287874 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:10.287837    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:14.197966 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:14.197926    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:14.284559 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:04:14.284522    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:04:15.623615 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:15.623582    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:16.387520 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.387491    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:16.587566 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.587524    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:16.738363 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.738254    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"]
Nov 01 04:04:16.741913 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.741890    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:16.797677 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.797643    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"]
Nov 01 04:04:16.852524 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.852486    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-aab51f\""
Nov 01 04:04:16.858234 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.852931    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-aab51f-dockercfg-xjfq4\""
Nov 01 04:04:16.883875 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.883833    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rvc8\" (UniqueName: \"kubernetes.io/projected/f5c34aef-1da1-499f-85db-4ff4646bcc44-kube-api-access-6rvc8\") pod \"payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf\" (UID: \"f5c34aef-1da1-499f-85db-4ff4646bcc44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:16.884348 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.884311    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5c34aef-1da1-499f-85db-4ff4646bcc44-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf\" (UID: \"f5c34aef-1da1-499f-85db-4ff4646bcc44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:16.931131 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.931081    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"]
Nov 01 04:04:16.938398 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.938368    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:16.961684 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.961639    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"]
Nov 01 04:04:16.985835 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.985798    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rvc8\" (UniqueName: \"kubernetes.io/projected/f5c34aef-1da1-499f-85db-4ff4646bcc44-kube-api-access-6rvc8\") pod \"payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf\" (UID: \"f5c34aef-1da1-499f-85db-4ff4646bcc44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:16.986039 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.985929    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5c34aef-1da1-499f-85db-4ff4646bcc44-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf\" (UID: \"f5c34aef-1da1-499f-85db-4ff4646bcc44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:16.986792 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:16.986765    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5c34aef-1da1-499f-85db-4ff4646bcc44-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf\" (UID: \"f5c34aef-1da1-499f-85db-4ff4646bcc44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:17.047510 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.047434    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rvc8\" (UniqueName: \"kubernetes.io/projected/f5c34aef-1da1-499f-85db-4ff4646bcc44-kube-api-access-6rvc8\") pod \"payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf\" (UID: \"f5c34aef-1da1-499f-85db-4ff4646bcc44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:17.056199 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.056155    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:17.087205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.087159    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m\" (UID: \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:17.087410 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.087300    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhnwr\" (UniqueName: \"kubernetes.io/projected/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-kube-api-access-zhnwr\") pod \"payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m\" (UID: \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:17.188666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.188627    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m\" (UID: \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:17.188855 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.188697    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhnwr\" (UniqueName: \"kubernetes.io/projected/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-kube-api-access-zhnwr\") pod \"payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m\" (UID: \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:17.189636 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.189610    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-plugins-config-volume\") pod \"payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m\" (UID: \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:17.250294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.250264    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhnwr\" (UniqueName: \"kubernetes.io/projected/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-kube-api-access-zhnwr\") pod \"payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m\" (UID: \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\") " pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:17.260452 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.260427    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:17.459154 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.459124    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"]
Nov 01 04:04:17.460901 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:04:17.460873    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c34aef_1da1_499f_85db_4ff4646bcc44.slice/crio-e0b26b456103241dc5493d1e5d57b8e64a00d9d731c3f63a0b30ac86b8d39147 WatchSource:0}: Error finding container e0b26b456103241dc5493d1e5d57b8e64a00d9d731c3f63a0b30ac86b8d39147: Status 404 returned error can't find the container with id e0b26b456103241dc5493d1e5d57b8e64a00d9d731c3f63a0b30ac86b8d39147
Nov 01 04:04:17.639882 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:17.639856    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"]
Nov 01 04:04:17.642095 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:04:17.642067    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be4fb7d_64ba_4f6b_8c4b_2f630323f1a6.slice/crio-0bd3b2f8f40256afd381a28fb2d2e55feb1d75021d4820dc339ce431735d3636 WatchSource:0}: Error finding container 0bd3b2f8f40256afd381a28fb2d2e55feb1d75021d4820dc339ce431735d3636: Status 404 returned error can't find the container with id 0bd3b2f8f40256afd381a28fb2d2e55feb1d75021d4820dc339ce431735d3636
Nov 01 04:04:18.103133 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.103049    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:18.243956 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.243918    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m" event={"ID":"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6","Type":"ContainerStarted","Data":"e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857"}
Nov 01 04:04:18.244197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.243980    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m" event={"ID":"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6","Type":"ContainerStarted","Data":"0bd3b2f8f40256afd381a28fb2d2e55feb1d75021d4820dc339ce431735d3636"}
Nov 01 04:04:18.244197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.244010    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:18.245667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.245642    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf" event={"ID":"f5c34aef-1da1-499f-85db-4ff4646bcc44","Type":"ContainerStarted","Data":"4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8"}
Nov 01 04:04:18.245782 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.245695    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:18.245782 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.245719    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf" event={"ID":"f5c34aef-1da1-499f-85db-4ff4646bcc44","Type":"ContainerStarted","Data":"e0b26b456103241dc5493d1e5d57b8e64a00d9d731c3f63a0b30ac86b8d39147"}
Nov 01 04:04:18.363500 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.363400    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m" podStartSLOduration=2.363384531 podStartE2EDuration="2.363384531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:04:18.359673283 +0000 UTC m=+1279.119401078" watchObservedRunningTime="2026-11-01 04:04:18.363384531 +0000 UTC m=+1279.123112325"
Nov 01 04:04:18.477511 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:18.477457    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf" podStartSLOduration=2.477443103 podStartE2EDuration="2.477443103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:04:18.475461499 +0000 UTC m=+1279.235189294" watchObservedRunningTime="2026-11-01 04:04:18.477443103 +0000 UTC m=+1279.237170897"
Nov 01 04:04:20.811144 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:20.811087    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:25.745667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:25.745632    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:29.255995 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:29.255965    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:04:29.256561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:29.256048    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:04:30.720941 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:30.720903    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:35.728051 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:35.728016    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:36.422494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:36.422444    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:37.630407 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.630373    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"]
Nov 01 04:04:37.635821 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.635799    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.689016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.688987    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-865066-openshift-default-dockercfg-97xzq\""
Nov 01 04:04:37.743408 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.743373    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"]
Nov 01 04:04:37.770529 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.770486    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-certs\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.770529 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.770532    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.770818 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.770735    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-token\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.770818 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.770793    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-data\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.770910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.770842    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-credential-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.770958 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.770919    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-envoy\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.771016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.771003    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-podinfo\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.771072 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.771045    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8vmr\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-kube-api-access-l8vmr\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.771201 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.771183    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad09f5d6-9f62-4d34-9873-cd5547105d89-istiod-ca-cert\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.872925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.872892    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-token\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.872937    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-data\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.872960    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-credential-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873034    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-envoy\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873056    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-podinfo\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873073    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8vmr\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-kube-api-access-l8vmr\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873136    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad09f5d6-9f62-4d34-9873-cd5547105d89-istiod-ca-cert\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873511 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873241    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-certs\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873511 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873272    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873557    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-credential-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873673 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873651    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-certs\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873724 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873683    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-data\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873809    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.873994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.873967    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad09f5d6-9f62-4d34-9873-cd5547105d89-istiod-ca-cert\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.875593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.875558    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-envoy\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.875779 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.875757    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-podinfo\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.934926 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.934841    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-token\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.935074 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.934949    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8vmr\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-kube-api-access-l8vmr\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-b5x68\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:37.950076 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:37.950046    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:38.391100 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:38.391068    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"]
Nov 01 04:04:38.392559 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:04:38.392536    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad09f5d6_9f62_4d34_9873_cd5547105d89.slice/crio-41df0f95051ef0760e1bdcfa054210d90211ce79560c06c381f585af0e199453 WatchSource:0}: Error finding container 41df0f95051ef0760e1bdcfa054210d90211ce79560c06c381f585af0e199453: Status 404 returned error can't find the container with id 41df0f95051ef0760e1bdcfa054210d90211ce79560c06c381f585af0e199453
Nov 01 04:04:38.395508 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:38.395472    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:04:38.395596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:38.395540    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:04:38.395596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:38.395573    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:04:39.386077 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:39.386041    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" event={"ID":"ad09f5d6-9f62-4d34-9873-cd5547105d89","Type":"ContainerStarted","Data":"2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52"}
Nov 01 04:04:39.386477 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:39.386090    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" event={"ID":"ad09f5d6-9f62-4d34-9873-cd5547105d89","Type":"ContainerStarted","Data":"41df0f95051ef0760e1bdcfa054210d90211ce79560c06c381f585af0e199453"}
Nov 01 04:04:39.557731 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:39.557674    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podStartSLOduration=2.557661618 podStartE2EDuration="2.557661618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:04:39.556872895 +0000 UTC m=+1300.316600691" watchObservedRunningTime="2026-11-01 04:04:39.557661618 +0000 UTC m=+1300.317389412"
Nov 01 04:04:39.950961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:39.950928    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:39.952713 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:39.952680    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 01 04:04:39.952933 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:39.952905    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 01 04:04:40.245373 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.242220    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"]
Nov 01 04:04:40.252462 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.252430    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.300660 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.300622    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"]
Nov 01 04:04:40.306029 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.305407    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-078e0d65\"/\"openshift-service-ca.crt\""
Nov 01 04:04:40.347485 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.347443    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-078e0d65\"/\"kube-root-ca.crt\""
Nov 01 04:04:40.347663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.347492    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-078e0d65\"/\"default-dockercfg-gm4kd\""
Nov 01 04:04:40.347663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.347548    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-078e0d65\"/\"e2e-lifecycle-model-078e0d65-kserve-self-signed-certs\""
Nov 01 04:04:40.401931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.400757    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:40.409197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.408669    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-home\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.409197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.408734    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-model-cache\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.409197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.408813    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-dshm\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.409197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.408911    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-tmp-dir\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.409197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.408940    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e07ea663-1a34-4988-99f2-1420a5a89365-tls-certs\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.409197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.409013    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4dd5\" (UniqueName: \"kubernetes.io/projected/e07ea663-1a34-4988-99f2-1420a5a89365-kube-api-access-z4dd5\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.510043 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.509949    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-dshm\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.510293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.510123    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-tmp-dir\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.510293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.510147    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e07ea663-1a34-4988-99f2-1420a5a89365-tls-certs\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.510293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.510273    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4dd5\" (UniqueName: \"kubernetes.io/projected/e07ea663-1a34-4988-99f2-1420a5a89365-kube-api-access-z4dd5\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.510474 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.510333    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-home\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.510474 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.510385    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-model-cache\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.517187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.513291    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-tmp-dir\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.517187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.513618    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-home\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.517187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.513844    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-model-cache\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.538678 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.535976    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-dshm\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.538678 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.536609    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e07ea663-1a34-4988-99f2-1420a5a89365-tls-certs\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.572592 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.572550    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4dd5\" (UniqueName: \"kubernetes.io/projected/e07ea663-1a34-4988-99f2-1420a5a89365-kube-api-access-z4dd5\") pod \"e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") " pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.876245 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.875470    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:40.950686 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.950652    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 01 04:04:40.950862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:40.950712    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 01 04:04:41.234249 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:41.224316    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:41.334188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:41.333293    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"]
Nov 01 04:04:41.343143 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:04:41.343113    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode07ea663_1a34_4988_99f2_1420a5a89365.slice/crio-71b1a9dd884a9405cb8fc32b837721683a956687f4d5f68012a0022c4c992b66 WatchSource:0}: Error finding container 71b1a9dd884a9405cb8fc32b837721683a956687f4d5f68012a0022c4c992b66: Status 404 returned error can't find the container with id 71b1a9dd884a9405cb8fc32b837721683a956687f4d5f68012a0022c4c992b66
Nov 01 04:04:41.443019 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:41.442980    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8" event={"ID":"e07ea663-1a34-4988-99f2-1420a5a89365","Type":"ContainerStarted","Data":"71b1a9dd884a9405cb8fc32b837721683a956687f4d5f68012a0022c4c992b66"}
Nov 01 04:04:41.950523 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:41.950494    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 01 04:04:41.950721 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:41.950542    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 01 04:04:42.450717 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:42.450678    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8" event={"ID":"e07ea663-1a34-4988-99f2-1420a5a89365","Type":"ContainerStarted","Data":"b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01"}
Nov 01 04:04:42.588014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:42.587959    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8" podStartSLOduration=2.58794227 podStartE2EDuration="2.58794227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:04:42.585937789 +0000 UTC m=+1303.345665585" watchObservedRunningTime="2026-11-01 04:04:42.58794227 +0000 UTC m=+1303.347670065"
Nov 01 04:04:42.875899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:42.875865    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:42.950812 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:42.950763    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 01 04:04:42.951018 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:42.950851    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 01 04:04:43.950966 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:43.950928    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 01 04:04:43.951515 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:43.950989    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 01 04:04:44.287078 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:04:44.286995    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:04:44.951470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:44.951425    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 01 04:04:44.951898 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:44.951494    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 01 04:04:45.955484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:45.955452    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:45.956018 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:45.955996    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:45.956857 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:45.956829    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:04:46.312693 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:46.312593    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:50.876873 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:50.876833    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:50.890196 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:50.890155    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:51.189045 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:51.188921    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:51.396087 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:51.396040    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:51.539207 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:51.539098    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:04:51.598755 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:51.598720    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:52.515794 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:52.515756    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:53.226337 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:53.226298    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:53.936202 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:53.935372    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:54.173383 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:54.173345    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:56.752932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:56.752900    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:58.984759 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:58.984706    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:04:59.191200 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:04:59.191142    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:02.062878 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:02.062845    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:05.473078 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.473050    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:05.675150 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.675110    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:05.825845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.825750    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"]
Nov 01 04:05:05.835527 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.835145    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:05.881529 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.881492    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"]
Nov 01 04:05:05.941640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.941608    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-3344e8\""
Nov 01 04:05:05.942033 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.942017    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-3344e8-dockercfg-zqxxn\""
Nov 01 04:05:05.950193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.948191    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkzhd\" (UniqueName: \"kubernetes.io/projected/23c6e165-eb44-40d6-b383-15d58b0f7a0a-kube-api-access-qkzhd\") pod \"payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f\" (UID: \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:05.950193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:05.948253    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23c6e165-eb44-40d6-b383-15d58b0f7a0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f\" (UID: \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:06.003186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.002235    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"]
Nov 01 04:05:06.007705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.007676    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:06.048943 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.048902    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"]
Nov 01 04:05:06.059276 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.059151    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkzhd\" (UniqueName: \"kubernetes.io/projected/23c6e165-eb44-40d6-b383-15d58b0f7a0a-kube-api-access-qkzhd\") pod \"payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f\" (UID: \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:06.059276 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.059241    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23c6e165-eb44-40d6-b383-15d58b0f7a0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f\" (UID: \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:06.062448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.062414    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23c6e165-eb44-40d6-b383-15d58b0f7a0a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f\" (UID: \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:06.126199 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.125159    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkzhd\" (UniqueName: \"kubernetes.io/projected/23c6e165-eb44-40d6-b383-15d58b0f7a0a-kube-api-access-qkzhd\") pod \"payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f\" (UID: \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:06.157611 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.157576    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:06.160197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.160157    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/375adffa-569f-43c7-9324-f36225c86031-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk\" (UID: \"375adffa-569f-43c7-9324-f36225c86031\") " pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:06.160361 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.160337    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfw67\" (UniqueName: \"kubernetes.io/projected/375adffa-569f-43c7-9324-f36225c86031-kube-api-access-nfw67\") pod \"payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk\" (UID: \"375adffa-569f-43c7-9324-f36225c86031\") " pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:06.263431 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.262252    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfw67\" (UniqueName: \"kubernetes.io/projected/375adffa-569f-43c7-9324-f36225c86031-kube-api-access-nfw67\") pod \"payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk\" (UID: \"375adffa-569f-43c7-9324-f36225c86031\") " pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:06.263431 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.262456    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/375adffa-569f-43c7-9324-f36225c86031-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk\" (UID: \"375adffa-569f-43c7-9324-f36225c86031\") " pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:06.263431 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.263383    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/375adffa-569f-43c7-9324-f36225c86031-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk\" (UID: \"375adffa-569f-43c7-9324-f36225c86031\") " pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:06.324769 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.324740    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfw67\" (UniqueName: \"kubernetes.io/projected/375adffa-569f-43c7-9324-f36225c86031-kube-api-access-nfw67\") pod \"payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk\" (UID: \"375adffa-569f-43c7-9324-f36225c86031\") " pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:06.350206 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.350153    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:06.550742 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.550713    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"]
Nov 01 04:05:06.551939 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:05:06.551909    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c6e165_eb44_40d6_b383_15d58b0f7a0a.slice/crio-4d867b8269ec34f93c06eadfbd28f86dc04a82f61354527628626606a4ae4a92 WatchSource:0}: Error finding container 4d867b8269ec34f93c06eadfbd28f86dc04a82f61354527628626606a4ae4a92: Status 404 returned error can't find the container with id 4d867b8269ec34f93c06eadfbd28f86dc04a82f61354527628626606a4ae4a92
Nov 01 04:05:06.640637 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.640597    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f" event={"ID":"23c6e165-eb44-40d6-b383-15d58b0f7a0a","Type":"ContainerStarted","Data":"63783479e78d003bc846bf8a78d6d9f402e22d2137e491af383557b8c7820a26"}
Nov 01 04:05:06.640828 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.640658    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f" event={"ID":"23c6e165-eb44-40d6-b383-15d58b0f7a0a","Type":"ContainerStarted","Data":"4d867b8269ec34f93c06eadfbd28f86dc04a82f61354527628626606a4ae4a92"}
Nov 01 04:05:06.640828 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.640705    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:06.734454 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.734421    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"]
Nov 01 04:05:06.734784 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:05:06.734756    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375adffa_569f_43c7_9324_f36225c86031.slice/crio-ad72cdff60defdfe0ce01b20db10fd365b243d59238d8580b30909b08468dc37 WatchSource:0}: Error finding container ad72cdff60defdfe0ce01b20db10fd365b243d59238d8580b30909b08468dc37: Status 404 returned error can't find the container with id ad72cdff60defdfe0ce01b20db10fd365b243d59238d8580b30909b08468dc37
Nov 01 04:05:06.761325 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:06.761275    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f" podStartSLOduration=1.761257971 podStartE2EDuration="1.761257971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:05:06.756753551 +0000 UTC m=+1327.516481348" watchObservedRunningTime="2026-11-01 04:05:06.761257971 +0000 UTC m=+1327.520985776"
Nov 01 04:05:07.238097 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:07.238044    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:07.649696 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:07.649656    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk" event={"ID":"375adffa-569f-43c7-9324-f36225c86031","Type":"ContainerStarted","Data":"c141b181a822f16b106f34362be2532f893962d1125bd6e36c31e50963e079ef"}
Nov 01 04:05:07.650277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:07.649725    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk" event={"ID":"375adffa-569f-43c7-9324-f36225c86031","Type":"ContainerStarted","Data":"ad72cdff60defdfe0ce01b20db10fd365b243d59238d8580b30909b08468dc37"}
Nov 01 04:05:07.650277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:07.649759    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:07.773967 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:07.773909    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk" podStartSLOduration=2.773894549 podStartE2EDuration="2.773894549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:05:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:05:07.770967792 +0000 UTC m=+1328.530695587" watchObservedRunningTime="2026-11-01 04:05:07.773894549 +0000 UTC m=+1328.533622344"
Nov 01 04:05:08.550796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:08.550767    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:12.238187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:12.237617    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:14.286339 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:05:14.286303    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:05:17.207955 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:17.207902    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:17.653637 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:17.653596    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:05:18.454178 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:18.454135    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:18.661635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:18.661607    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:05:22.210746 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:22.210676    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:23.003936 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.003903    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"]
Nov 01 04:05:23.007940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.007922    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.095526 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.095490    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"]
Nov 01 04:05:23.095709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.095625    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcpgb\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-kube-api-access-lcpgb\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.095709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.095655    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-envoy\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.095709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.095672    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-data\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.095889 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.095835    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-credential-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.095967 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.095953    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.096028 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.095980    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-podinfo\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.096084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.096027    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-token\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.096084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.096070    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae9f650-0909-457b-8bdc-a4756fdfef2a-istiod-ca-cert\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.096241 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.096121    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-certs\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.197797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.197762    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-credential-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.197974 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.197878    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.197974 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.197900    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-podinfo\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.197974 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.197947    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-token\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.197974 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.197972    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae9f650-0909-457b-8bdc-a4756fdfef2a-istiod-ca-cert\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198208 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198028    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-certs\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198208 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198110    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcpgb\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-kube-api-access-lcpgb\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198208 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198139    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-envoy\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198208 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198197    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-data\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198274    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-credential-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198330    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-socket\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198679    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-certs\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198855 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198745    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-data\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.198855 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.198844    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae9f650-0909-457b-8bdc-a4756fdfef2a-istiod-ca-cert\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.200553 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.200529    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-podinfo\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.200868 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.200846    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-envoy\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.259399 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.259329    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-token\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.259742 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.259395    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcpgb\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-kube-api-access-lcpgb\") pod \"e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") " pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.323971 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.323939    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:23.764095 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.764064    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"]
Nov 01 04:05:23.766095 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:05:23.766067    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae9f650_0909_457b_8bdc_a4756fdfef2a.slice/crio-66092605e0e99bd6639b1f3eb994318702e07379530aa67a81942665c82851ba WatchSource:0}: Error finding container 66092605e0e99bd6639b1f3eb994318702e07379530aa67a81942665c82851ba: Status 404 returned error can't find the container with id 66092605e0e99bd6639b1f3eb994318702e07379530aa67a81942665c82851ba
Nov 01 04:05:23.769261 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.769219    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:05:23.769371 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.769311    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:05:23.769371 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.769360    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:05:23.778198 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:23.778146    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" event={"ID":"dae9f650-0909-457b-8bdc-a4756fdfef2a","Type":"ContainerStarted","Data":"66092605e0e99bd6639b1f3eb994318702e07379530aa67a81942665c82851ba"}
Nov 01 04:05:24.788085 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:24.788044    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" event={"ID":"dae9f650-0909-457b-8bdc-a4756fdfef2a","Type":"ContainerStarted","Data":"160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79"}
Nov 01 04:05:24.962233 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:24.962157    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podStartSLOduration=2.962140968 podStartE2EDuration="2.962140968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:05:24.959376857 +0000 UTC m=+1345.719104652" watchObservedRunningTime="2026-11-01 04:05:24.962140968 +0000 UTC m=+1345.721868829"
Nov 01 04:05:25.332376 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:25.328225    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:25.332376 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:25.329874    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 01 04:05:25.332376 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:25.329942    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 01 04:05:26.330186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:26.329267    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 01 04:05:26.330186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:26.329336    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 01 04:05:27.247185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:27.238662    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:27.333188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:27.325270    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 01 04:05:27.333188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:27.325335    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 01 04:05:28.328663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:28.328615    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 01 04:05:28.328970 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:28.328932    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 01 04:05:29.330613 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:29.330572    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 01 04:05:29.331274 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:29.331230    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 01 04:05:30.324935 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:30.324892    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 01 04:05:30.325143 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:30.324972    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 01 04:05:31.329852 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:31.329821    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:31.330367 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:31.330217    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:31.330938 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:31.330915    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:05:34.352032 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:34.351970    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:37.213835 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:37.213797    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:38.673658 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:38.673557    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:39.280375 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:39.280294    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:39.732817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:39.732779    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:42.444608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:42.444570    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:43.908399 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:43.908365    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:44.108812 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:44.108752    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:44.285905 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:05:44.285814    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:05:46.277996 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:46.277954    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:46.979998 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:46.979966    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:47.427864 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.427816    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"]
Nov 01 04:05:47.433244 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.433225    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.491703 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.491667    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:47.526050 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.526016    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"]
Nov 01 04:05:47.552083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.552046    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6dd36b-openshift-default-dockercfg-k2cb5\""
Nov 01 04:05:47.579426 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.579396    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-envoy\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.579716 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.579700    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-credential-socket\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.579869 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.579857    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8qhd\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-kube-api-access-v8qhd\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.579994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.579978    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-certs\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.580242 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.580219    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-token\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.580461 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.580446    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istiod-ca-cert\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.580599 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.580587    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-data\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.580704 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.580692    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-podinfo\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.580843 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.580822    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-socket\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682245 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682138    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istiod-ca-cert\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682422 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682248    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-data\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682422 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682283    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-podinfo\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682422 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682364    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-socket\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682428    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-envoy\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682486    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-credential-socket\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682515    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8qhd\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-kube-api-access-v8qhd\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682550    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-certs\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.682691 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.682625    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-token\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.683209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.683146    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-socket\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.683382 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.683180    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-credential-socket\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.684009 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.683988    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-data\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.684325 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.684295    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istiod-ca-cert\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.684433 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.684397    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-certs\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.685907 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.685844    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-envoy\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.686282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.686262    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-podinfo\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.766797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.765966    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:47.773840 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.773812    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-token\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.788934 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.788901    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8qhd\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-kube-api-access-v8qhd\") pod \"e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") " pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:47.974266 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:47.972630    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:48.008036 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.007986    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"]
Nov 01 04:05:48.026196 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.023724    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:48.050708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.050678    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:48.086187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.082531    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"]
Nov 01 04:05:48.086366 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.086288    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-78dad9\""
Nov 01 04:05:48.104304 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.103928    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m259s\" (UniqueName: \"kubernetes.io/projected/81d60b83-4736-480b-9f4b-6d58afa39565-kube-api-access-m259s\") pod \"payload-processing-e2e-api-a-78dad9-7c985bb45-49b92\" (UID: \"81d60b83-4736-480b-9f4b-6d58afa39565\") " pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:48.104304 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.104179    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d60b83-4736-480b-9f4b-6d58afa39565-plugins-config-volume\") pod \"payload-processing-e2e-api-a-78dad9-7c985bb45-49b92\" (UID: \"81d60b83-4736-480b-9f4b-6d58afa39565\") " pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:48.156187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.153027    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-78dad9-dockercfg-psdn8\""
Nov 01 04:05:48.174270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.174212    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:48.208239 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.208201    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d60b83-4736-480b-9f4b-6d58afa39565-plugins-config-volume\") pod \"payload-processing-e2e-api-a-78dad9-7c985bb45-49b92\" (UID: \"81d60b83-4736-480b-9f4b-6d58afa39565\") " pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:48.208487 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.208450    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m259s\" (UniqueName: \"kubernetes.io/projected/81d60b83-4736-480b-9f4b-6d58afa39565-kube-api-access-m259s\") pod \"payload-processing-e2e-api-a-78dad9-7c985bb45-49b92\" (UID: \"81d60b83-4736-480b-9f4b-6d58afa39565\") " pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:48.210144 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.210118    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d60b83-4736-480b-9f4b-6d58afa39565-plugins-config-volume\") pod \"payload-processing-e2e-api-a-78dad9-7c985bb45-49b92\" (UID: \"81d60b83-4736-480b-9f4b-6d58afa39565\") " pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:48.274786 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.272426    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m259s\" (UniqueName: \"kubernetes.io/projected/81d60b83-4736-480b-9f4b-6d58afa39565-kube-api-access-m259s\") pod \"payload-processing-e2e-api-a-78dad9-7c985bb45-49b92\" (UID: \"81d60b83-4736-480b-9f4b-6d58afa39565\") " pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:48.397493 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.397453    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:48.577752 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.577718    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"]
Nov 01 04:05:48.578879 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:05:48.578853    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87e9c6b_09fd_4b78_9fac_94afc5351c6b.slice/crio-30381af4059c5bd918c1ab4f03ab5ca53e41d975e976905cf84615608822a887 WatchSource:0}: Error finding container 30381af4059c5bd918c1ab4f03ab5ca53e41d975e976905cf84615608822a887: Status 404 returned error can't find the container with id 30381af4059c5bd918c1ab4f03ab5ca53e41d975e976905cf84615608822a887
Nov 01 04:05:48.581471 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.581435    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:05:48.581566 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.581504    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:05:48.581566 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.581531    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:05:48.801792 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:48.801715    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"]
Nov 01 04:05:48.806442 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:05:48.806398    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d60b83_4736_480b_9f4b_6d58afa39565.slice/crio-1df2748b2eb8b1f4bf54721bd13859c25436a98e5ccd39326c17b00b60f9bc17 WatchSource:0}: Error finding container 1df2748b2eb8b1f4bf54721bd13859c25436a98e5ccd39326c17b00b60f9bc17: Status 404 returned error can't find the container with id 1df2748b2eb8b1f4bf54721bd13859c25436a98e5ccd39326c17b00b60f9bc17
Nov 01 04:05:49.009959 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.009919    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" event={"ID":"f87e9c6b-09fd-4b78-9fac-94afc5351c6b","Type":"ContainerStarted","Data":"b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179"}
Nov 01 04:05:49.010180 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.009985    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" event={"ID":"f87e9c6b-09fd-4b78-9fac-94afc5351c6b","Type":"ContainerStarted","Data":"30381af4059c5bd918c1ab4f03ab5ca53e41d975e976905cf84615608822a887"}
Nov 01 04:05:49.012259 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.012225    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92" event={"ID":"81d60b83-4736-480b-9f4b-6d58afa39565","Type":"ContainerStarted","Data":"95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4"}
Nov 01 04:05:49.012416 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.012284    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92" event={"ID":"81d60b83-4736-480b-9f4b-6d58afa39565","Type":"ContainerStarted","Data":"1df2748b2eb8b1f4bf54721bd13859c25436a98e5ccd39326c17b00b60f9bc17"}
Nov 01 04:05:49.012536 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.012504    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:05:49.052116 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.052080    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:49.057869 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.057839    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:49.133812 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.133752    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" podStartSLOduration=2.13373415 podStartE2EDuration="2.13373415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:05:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:05:49.132028832 +0000 UTC m=+1369.891756628" watchObservedRunningTime="2026-11-01 04:05:49.13373415 +0000 UTC m=+1369.893461948"
Nov 01 04:05:49.259455 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.258101    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92" podStartSLOduration=2.258082193 podStartE2EDuration="2.258082193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:05:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:05:49.258048882 +0000 UTC m=+1370.017776678" watchObservedRunningTime="2026-11-01 04:05:49.258082193 +0000 UTC m=+1370.017809989"
Nov 01 04:05:49.575216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.575083    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:49.774619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:49.774589    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:50.023267 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:50.023231    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:50.024525 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:50.024503    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:05:51.942353 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:51.942319    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:52.143225 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:52.143158    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:53.436045 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:53.436013    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:54.688198 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:54.687669    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:56.889424 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:56.889367    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:57.088963 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.088886    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:57.565683 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.565652    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"]
Nov 01 04:05:57.573550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.573518    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:57.625251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.625215    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"]
Nov 01 04:05:57.670817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.670791    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-6dd36b\""
Nov 01 04:05:57.671050 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.670885    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-6dd36b-dockercfg-dxnhd\""
Nov 01 04:05:57.753069 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.753029    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29qs9\" (UniqueName: \"kubernetes.io/projected/09f87294-171e-4552-a626-06fb0832d350-kube-api-access-29qs9\") pod \"payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g\" (UID: \"09f87294-171e-4552-a626-06fb0832d350\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:57.753505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.753475    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09f87294-171e-4552-a626-06fb0832d350-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g\" (UID: \"09f87294-171e-4552-a626-06fb0832d350\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:57.855203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.855100    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09f87294-171e-4552-a626-06fb0832d350-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g\" (UID: \"09f87294-171e-4552-a626-06fb0832d350\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:57.855366 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.855346    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29qs9\" (UniqueName: \"kubernetes.io/projected/09f87294-171e-4552-a626-06fb0832d350-kube-api-access-29qs9\") pod \"payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g\" (UID: \"09f87294-171e-4552-a626-06fb0832d350\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:57.856149 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.856118    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09f87294-171e-4552-a626-06fb0832d350-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g\" (UID: \"09f87294-171e-4552-a626-06fb0832d350\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:57.917327 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:57.917293    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29qs9\" (UniqueName: \"kubernetes.io/projected/09f87294-171e-4552-a626-06fb0832d350-kube-api-access-29qs9\") pod \"payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g\" (UID: \"09f87294-171e-4552-a626-06fb0832d350\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:58.197684 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:58.197648    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:58.259761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:58.259730    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:58.583451 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:58.583426    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"]
Nov 01 04:05:58.586522 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:05:58.586489    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f87294_171e_4552_a626_06fb0832d350.slice/crio-cb37d22fc82b7fec9a04da2be0ae7faf95d5191972b0a0a79449037fa16ac6fa WatchSource:0}: Error finding container cb37d22fc82b7fec9a04da2be0ae7faf95d5191972b0a0a79449037fa16ac6fa: Status 404 returned error can't find the container with id cb37d22fc82b7fec9a04da2be0ae7faf95d5191972b0a0a79449037fa16ac6fa
Nov 01 04:05:58.865495 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:58.865400    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:59.072184 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:59.064273    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:05:59.163209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:59.161971    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g" event={"ID":"09f87294-171e-4552-a626-06fb0832d350","Type":"ContainerStarted","Data":"b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48"}
Nov 01 04:05:59.163209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:59.162041    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g" event={"ID":"09f87294-171e-4552-a626-06fb0832d350","Type":"ContainerStarted","Data":"cb37d22fc82b7fec9a04da2be0ae7faf95d5191972b0a0a79449037fa16ac6fa"}
Nov 01 04:05:59.163472 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:59.163453    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:05:59.282248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:05:59.282150    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g" podStartSLOduration=2.282134872 podStartE2EDuration="2.282134872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:05:59.279464237 +0000 UTC m=+1380.039192032" watchObservedRunningTime="2026-11-01 04:05:59.282134872 +0000 UTC m=+1380.041862703"
Nov 01 04:06:00.027135 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:00.027104    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:06:02.804504 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:02.804472    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:03.005367 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:03.005333    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:04.117014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:04.116981    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:05.976844 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:05.976804    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:06.176948 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.176897    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:06.331701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.331622    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"]
Nov 01 04:06:06.337261 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.337229    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:06.389703 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.389667    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"]
Nov 01 04:06:06.389960 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.389783    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-4adf4c\""
Nov 01 04:06:06.390274 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.390250    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a051d661-123d-439f-aa76-fc5fea5d4c1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv\" (UID: \"a051d661-123d-439f-aa76-fc5fea5d4c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:06.390385 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.390284    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l9fp\" (UniqueName: \"kubernetes.io/projected/a051d661-123d-439f-aa76-fc5fea5d4c1c-kube-api-access-5l9fp\") pod \"payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv\" (UID: \"a051d661-123d-439f-aa76-fc5fea5d4c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:06.435707 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.435678    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-4adf4c-dockercfg-lgpq4\""
Nov 01 04:06:06.515561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.515524    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a051d661-123d-439f-aa76-fc5fea5d4c1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv\" (UID: \"a051d661-123d-439f-aa76-fc5fea5d4c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:06.515767 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.515571    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l9fp\" (UniqueName: \"kubernetes.io/projected/a051d661-123d-439f-aa76-fc5fea5d4c1c-kube-api-access-5l9fp\") pod \"payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv\" (UID: \"a051d661-123d-439f-aa76-fc5fea5d4c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:06.516532 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.516504    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a051d661-123d-439f-aa76-fc5fea5d4c1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv\" (UID: \"a051d661-123d-439f-aa76-fc5fea5d4c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:06.608102 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.608027    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l9fp\" (UniqueName: \"kubernetes.io/projected/a051d661-123d-439f-aa76-fc5fea5d4c1c-kube-api-access-5l9fp\") pod \"payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv\" (UID: \"a051d661-123d-439f-aa76-fc5fea5d4c1c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:06.657459 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:06.657422    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:07.043795 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:07.043763    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"]
Nov 01 04:06:07.045557 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:06:07.045528    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda051d661_123d_439f_aa76_fc5fea5d4c1c.slice/crio-ba924dba39b17a10fabb2a9a70df924892f30e47938faf9a32929077b10481e5 WatchSource:0}: Error finding container ba924dba39b17a10fabb2a9a70df924892f30e47938faf9a32929077b10481e5: Status 404 returned error can't find the container with id ba924dba39b17a10fabb2a9a70df924892f30e47938faf9a32929077b10481e5
Nov 01 04:06:07.227138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:07.227099    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv" event={"ID":"a051d661-123d-439f-aa76-fc5fea5d4c1c","Type":"ContainerStarted","Data":"00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b"}
Nov 01 04:06:07.227375 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:07.227172    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv" event={"ID":"a051d661-123d-439f-aa76-fc5fea5d4c1c","Type":"ContainerStarted","Data":"ba924dba39b17a10fabb2a9a70df924892f30e47938faf9a32929077b10481e5"}
Nov 01 04:06:07.227375 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:07.227225    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:07.346641 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:07.346539    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv" podStartSLOduration=1.346525515 podStartE2EDuration="1.346525515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:06:07.343486906 +0000 UTC m=+1388.103214701" watchObservedRunningTime="2026-11-01 04:06:07.346525515 +0000 UTC m=+1388.106253310"
Nov 01 04:06:08.898293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:08.898261    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:09.313363 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:09.313257    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:11.183931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:11.183902    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:06:12.154203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:12.154141    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:14.284607 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:06:14.284567    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:06:14.310807 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:14.310760    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:18.238042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:18.238012    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:06:18.872622 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:18.872571    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:19.318205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:19.318141    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:24.315791 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:24.315757    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:29.324425 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:29.324388    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:33.895831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:33.895794    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"]
Nov 01 04:06:33.901497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:33.901476    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:33.956143 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:33.956108    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"]
Nov 01 04:06:34.001004 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.000953    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-78dad9-serving-cert\""
Nov 01 04:06:34.010926 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.010889    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpszk\" (UniqueName: \"kubernetes.io/projected/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-kube-api-access-bpszk\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.011092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.010959    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-metrics-certs\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.011092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.011053    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-openshift-service-ca\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.011335 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.011318    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.112887 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.112842    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-openshift-service-ca\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.113107 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.113089    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.113222 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.113150    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpszk\" (UniqueName: \"kubernetes.io/projected/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-kube-api-access-bpszk\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.113222 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.113208    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-metrics-certs\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.113348 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:06:34.113265    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-serving-cert: secret "maas-api-e2e-api-a-78dad9-serving-cert" not found
Nov 01 04:06:34.113408 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:06:34.113348    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls podName:366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27 nodeName:}" failed. No retries permitted until 2026-11-01 04:06:34.613333906 +0000 UTC m=+1415.373061692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls") pod "maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww" (UID: "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27") : secret "maas-api-e2e-api-a-78dad9-serving-cert" not found
Nov 01 04:06:34.113569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.113546    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-openshift-service-ca\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.115717 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.115694    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-metrics-certs\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.156751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.156646    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:34.175201 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.175140    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpszk\" (UniqueName: \"kubernetes.io/projected/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-kube-api-access-bpszk\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.362854 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.362821    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:34.624591 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.624565    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.627081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.627053    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls\") pod \"maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:34.815403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:34.815371    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:35.198700 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:35.198676    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"]
Nov 01 04:06:35.200735 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:06:35.200699    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366bf4d7_0b8f_4f48_9441_6c0fbbbb3c27.slice/crio-76a0f94a6367f0d070693474f032d3e26b19a7f025c7fac359779e280bc6cfe1 WatchSource:0}: Error finding container 76a0f94a6367f0d070693474f032d3e26b19a7f025c7fac359779e280bc6cfe1: Status 404 returned error can't find the container with id 76a0f94a6367f0d070693474f032d3e26b19a7f025c7fac359779e280bc6cfe1
Nov 01 04:06:35.202253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:35.202232    5529 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 04:06:35.452273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:35.452192    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww" event={"ID":"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27","Type":"ContainerStarted","Data":"76a0f94a6367f0d070693474f032d3e26b19a7f025c7fac359779e280bc6cfe1"}
Nov 01 04:06:36.461232 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:36.461194    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww" event={"ID":"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27","Type":"ContainerStarted","Data":"b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66"}
Nov 01 04:06:36.461663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:36.461292    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:36.598898 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:36.598802    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww" podStartSLOduration=2.51490381 podStartE2EDuration="3.59878391s" totalImagesPullingTime="1.0838801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:06:36.595415403 +0000 UTC m=+1417.355143195" watchObservedRunningTime="2026-11-01 04:06:36.59878391 +0000 UTC m=+1417.358511709"
Nov 01 04:06:39.325505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:39.325465    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:42.473973 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:42.473940    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:06:44.284549 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:06:44.284506    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:06:44.338593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:44.338561    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:46.389480 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:46.389445    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7422-5e957c"]
Nov 01 04:06:46.393811 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:46.393788    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-5e957c"
Nov 01 04:06:46.453031 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:46.452998    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-5e957c"]
Nov 01 04:06:46.491597 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:46.491561    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zjjms\""
Nov 01 04:06:46.496385 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:46.496360    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjjk6\" (UniqueName: \"kubernetes.io/projected/c2c90209-8bd6-49d5-81a3-f5ac96bafaa2-kube-api-access-mjjk6\") pod \"test-curl-7422-5e957c\" (UID: \"c2c90209-8bd6-49d5-81a3-f5ac96bafaa2\") " pod="opendatahub/test-curl-7422-5e957c"
Nov 01 04:06:46.598367 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:46.598328    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjjk6\" (UniqueName: \"kubernetes.io/projected/c2c90209-8bd6-49d5-81a3-f5ac96bafaa2-kube-api-access-mjjk6\") pod \"test-curl-7422-5e957c\" (UID: \"c2c90209-8bd6-49d5-81a3-f5ac96bafaa2\") " pod="opendatahub/test-curl-7422-5e957c"
Nov 01 04:06:46.660510 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:46.660440    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjjk6\" (UniqueName: \"kubernetes.io/projected/c2c90209-8bd6-49d5-81a3-f5ac96bafaa2-kube-api-access-mjjk6\") pod \"test-curl-7422-5e957c\" (UID: \"c2c90209-8bd6-49d5-81a3-f5ac96bafaa2\") " pod="opendatahub/test-curl-7422-5e957c"
Nov 01 04:06:46.706092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:46.706060    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-5e957c"
Nov 01 04:06:47.106268 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:47.098888    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7422-5e957c"]
Nov 01 04:06:47.106268 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:06:47.100415    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2c90209_8bd6_49d5_81a3_f5ac96bafaa2.slice/crio-a76da5196e2b6e725ccf1c16cdb470ad92e85e9e770efaac5b78b73186c0bed7 WatchSource:0}: Error finding container a76da5196e2b6e725ccf1c16cdb470ad92e85e9e770efaac5b78b73186c0bed7: Status 404 returned error can't find the container with id a76da5196e2b6e725ccf1c16cdb470ad92e85e9e770efaac5b78b73186c0bed7
Nov 01 04:06:47.546252 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:47.546202    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-5e957c" event={"ID":"c2c90209-8bd6-49d5-81a3-f5ac96bafaa2","Type":"ContainerStarted","Data":"a76da5196e2b6e725ccf1c16cdb470ad92e85e9e770efaac5b78b73186c0bed7"}
Nov 01 04:06:49.249983 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:49.249940    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:49.586145 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:49.586043    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7422-5e957c" event={"ID":"c2c90209-8bd6-49d5-81a3-f5ac96bafaa2","Type":"ContainerStarted","Data":"2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b"}
Nov 01 04:06:49.703353 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:49.703290    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7422-5e957c" podStartSLOduration=2.156528299 podStartE2EDuration="3.703274914s" totalImagesPullingTime="1.546746615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:06:49.700541044 +0000 UTC m=+1430.460268838" watchObservedRunningTime="2026-11-01 04:06:49.703274914 +0000 UTC m=+1430.463002708"
Nov 01 04:06:50.890035 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:50.889983    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:51.153973 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:51.153888    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:51.215565 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:51.215526    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7422-5e957c"]
Nov 01 04:06:51.220638 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:51.220608    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7422-5e957c"]
Nov 01 04:06:51.601892 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:51.601779    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7422-5e957c" podUID="c2c90209-8bd6-49d5-81a3-f5ac96bafaa2" containerName="test-curl-7422-5e957c" containerID="cri-o://2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b" gracePeriod=2
Nov 01 04:06:53.879623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:53.879596    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-5e957c"
Nov 01 04:06:53.930378 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:53.930350    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2c90209-8bd6-49d5-81a3-f5ac96bafaa2-kube-api-access-mjjk6\" (UniqueName: \"kubernetes.io/projected/c2c90209-8bd6-49d5-81a3-f5ac96bafaa2-kube-api-access-mjjk6\") pod \"c2c90209-8bd6-49d5-81a3-f5ac96bafaa2\" (UID: \"c2c90209-8bd6-49d5-81a3-f5ac96bafaa2\") "
Nov 01 04:06:53.932626 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:53.932603    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2c90209-8bd6-49d5-81a3-f5ac96bafaa2-kube-api-access-mjjk6" pod "c2c90209-8bd6-49d5-81a3-f5ac96bafaa2" (UID: "c2c90209-8bd6-49d5-81a3-f5ac96bafaa2"). InnerVolumeSpecName "kube-api-access-mjjk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:06:54.032377 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:54.032336    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjjk6\" (UniqueName: \"kubernetes.io/projected/c2c90209-8bd6-49d5-81a3-f5ac96bafaa2-kube-api-access-mjjk6\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:06:54.627501 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:54.627459    5529 generic.go:356] "Generic (PLEG): container finished" podID="c2c90209-8bd6-49d5-81a3-f5ac96bafaa2" containerID="2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b" exitCode=137
Nov 01 04:06:54.627501 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:54.627504    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7422-5e957c"
Nov 01 04:06:54.627741 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:54.627548    5529 scope.go:122] "RemoveContainer" containerID="2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b"
Nov 01 04:06:54.638469 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:54.638451    5529 scope.go:122] "RemoveContainer" containerID="2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b"
Nov 01 04:06:54.638823 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:06:54.638803    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b\": container with ID starting with 2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b not found: ID does not exist" containerID="2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b"
Nov 01 04:06:54.638877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:54.638833    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b"} err="failed to get container status \"2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b\": rpc error: code = NotFound desc = could not find container \"2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b\": container with ID starting with 2622849e9d84caa6410db584327d67eb7d62d0c69c3677233ca52d49e9f3a64b not found: ID does not exist"
Nov 01 04:06:54.688494 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:06:54.688457    5529 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7422-5e957c\" is forbidden: User \"system:node:ip-10-0-136-214.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-214.us-west-2.compute.internal' and this object" podUID="c2c90209-8bd6-49d5-81a3-f5ac96bafaa2" pod="opendatahub/test-curl-7422-5e957c"
Nov 01 04:06:54.839337 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:54.839281    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:06:55.375182 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:06:55.375137    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2c90209-8bd6-49d5-81a3-f5ac96bafaa2" path="/var/lib/kubelet/pods/c2c90209-8bd6-49d5-81a3-f5ac96bafaa2/volumes"
Nov 01 04:07:00.210608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:00.210559    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:04.003209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:04.002534    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:04.208754 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:04.208715    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:05.102307 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.102274    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"]
Nov 01 04:07:05.103901 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.103870    5529 cpu_manager.go:414] "containerMap: removing container" podUID="c2c90209-8bd6-49d5-81a3-f5ac96bafaa2" containerName="test-curl-7422-5e957c"
Nov 01 04:07:05.103901 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.103901    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2c90209-8bd6-49d5-81a3-f5ac96bafaa2" containerName="test-curl-7422-5e957c"
Nov 01 04:07:05.104118 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.104045    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2c90209-8bd6-49d5-81a3-f5ac96bafaa2" containerName="test-curl-7422-5e957c"
Nov 01 04:07:05.109760 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.109737    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.175452 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.169684    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"]
Nov 01 04:07:05.187138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.187104    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.187397 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.187208    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psjzv\" (UniqueName: \"kubernetes.io/projected/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-kube-api-access-psjzv\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.187397 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.187359    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.187735 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.187398    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.211774 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.211730    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-4adf4c-serving-cert\""
Nov 01 04:07:05.288827 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.288784    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.289057 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.288901    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psjzv\" (UniqueName: \"kubernetes.io/projected/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-kube-api-access-psjzv\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.289057 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.289019    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.289207 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.289075    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.289874 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:07:05.289848    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-serving-cert: secret "maas-api-e2e-shared-a-w2-4adf4c-serving-cert" not found
Nov 01 04:07:05.290005 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:07:05.289917    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls podName:e53644f9-dd7a-48a7-bf11-e208d7d9a64f nodeName:}" failed. No retries permitted until 2026-11-01 04:07:05.78989786 +0000 UTC m=+1446.549625648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls") pod "maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh" (UID: "e53644f9-dd7a-48a7-bf11-e208d7d9a64f") : secret "maas-api-e2e-shared-a-w2-4adf4c-serving-cert" not found
Nov 01 04:07:05.290969 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.290944    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.293718 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.293695    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.350459 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.350423    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:05.352457 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.352395    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psjzv\" (UniqueName: \"kubernetes.io/projected/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-kube-api-access-psjzv\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.558062 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.558025    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:05.767604 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.767572    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:05.802828 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.802797    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:05.805432 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:05.805405    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:06.029269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:06.029151    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:06.420934 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:07:06.420892    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53644f9_dd7a_48a7_bf11_e208d7d9a64f.slice/crio-254baf1df8fb79fc4c24b64aa55eb7af48324309d324f895516dafc66296f0ac WatchSource:0}: Error finding container 254baf1df8fb79fc4c24b64aa55eb7af48324309d324f895516dafc66296f0ac: Status 404 returned error can't find the container with id 254baf1df8fb79fc4c24b64aa55eb7af48324309d324f895516dafc66296f0ac
Nov 01 04:07:06.421456 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:06.421430    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"]
Nov 01 04:07:06.716450 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:06.716322    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh" event={"ID":"e53644f9-dd7a-48a7-bf11-e208d7d9a64f","Type":"ContainerStarted","Data":"254baf1df8fb79fc4c24b64aa55eb7af48324309d324f895516dafc66296f0ac"}
Nov 01 04:07:07.741211 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:07.740128    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh" event={"ID":"e53644f9-dd7a-48a7-bf11-e208d7d9a64f","Type":"ContainerStarted","Data":"90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed"}
Nov 01 04:07:07.741740 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:07.741660    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:07.862513 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:07.862393    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh" podStartSLOduration=1.980881815 podStartE2EDuration="2.86237418s" totalImagesPullingTime="881.492365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:07:07.861507423 +0000 UTC m=+1448.621235218" watchObservedRunningTime="2026-11-01 04:07:07.86237418 +0000 UTC m=+1448.622101977"
Nov 01 04:07:08.901471 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:08.901430    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:09.100638 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:09.100596    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:09.301830 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:09.301748    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:10.549186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:10.548178    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:14.285035 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:07:14.284994    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:07:14.762547 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:14.762515    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:07:15.707279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:15.707184    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:18.823918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:18.823881    5529 generic.go:356] "Generic (PLEG): container finished" podID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerID="b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179" exitCode=0
Nov 01 04:07:18.824745 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:18.823949    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" event={"ID":"f87e9c6b-09fd-4b78-9fac-94afc5351c6b","Type":"ContainerDied","Data":"b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179"}
Nov 01 04:07:18.824745 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:18.824422    5529 scope.go:122] "RemoveContainer" containerID="b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179"
Nov 01 04:07:18.826054 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:18.826027    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:07:18.826112 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:18.826097    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:07:18.826185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:18.826148    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:07:19.214138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:19.214104    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:19.847192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:19.847125    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" event={"ID":"f87e9c6b-09fd-4b78-9fac-94afc5351c6b","Type":"ContainerStarted","Data":"6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6"}
Nov 01 04:07:20.025472 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:20.025442    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:07:20.051659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:20.051626    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:07:20.053098 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:20.053071    5529 patch_prober.go:29] interesting pod/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 01 04:07:20.053248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:20.053127    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 01 04:07:20.732400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:20.732366    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:21.052781 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:21.052689    5529 patch_prober.go:29] interesting pod/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 01 04:07:21.052781 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:21.052747    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 01 04:07:22.052504 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:22.052469    5529 patch_prober.go:29] interesting pod/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 01 04:07:22.052690 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:22.052537    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 01 04:07:23.051853 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:23.051808    5529 patch_prober.go:29] interesting pod/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 01 04:07:23.052443 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:23.051886    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 01 04:07:24.052787 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:24.052740    5529 patch_prober.go:29] interesting pod/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Nov 01 04:07:24.053315 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:24.052808    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Nov 01 04:07:25.057116 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:25.057084    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:07:25.058319 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:25.058289    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:07:25.819596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:25.819557    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:30.753797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:30.753746    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:35.808691 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:35.808657    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:40.728380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:40.728345    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:41.405508 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:41.405474    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:41.611778 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:41.611742    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:42.147132 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:42.147080    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:42.624504 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:42.624463    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:44.285204 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:07:44.285146    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:07:46.538992 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:46.538957    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:46.879757 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:46.879721    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:47.083054 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:47.083016    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:47.288006 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:47.287913    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:50.053704 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:50.053667    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:50.248692 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:50.248656    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:52.063825 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:52.063778    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:54.426782 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:54.426748    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:57.484225 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:57.484135    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:07:59.602770 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:59.602742    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:07:59.608483 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:07:59.608449    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:08:02.713950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:02.713920    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:07.787797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:07.787755    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:09.615209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:09.615146    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:09.935486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:09.935447    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"]
Nov 01 04:08:10.043296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:10.043268    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"]
Nov 01 04:08:10.264440 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:10.264358    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:10.472261 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:10.472185    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:10.687231 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:10.687194    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:11.291969 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:11.291933    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:11.604793 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:11.604707    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:13.385470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:13.385411    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:14.285047 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:14.285010    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:08:14.936557 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:14.936515    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m" podUID="7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6" containerName="payload-processing" containerID="cri-o://e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857" gracePeriod=25
Nov 01 04:08:15.044117 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.044040    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf" podUID="f5c34aef-1da1-499f-85db-4ff4646bcc44" containerName="payload-pre-processing" containerID="cri-o://4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8" gracePeriod=25
Nov 01 04:08:15.217158 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.217123    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:08:15.327597 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.327566    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-plugins-config-volume\") pod \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\" (UID: \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\") "
Nov 01 04:08:15.327732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.327708    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-kube-api-access-zhnwr\" (UniqueName: \"kubernetes.io/projected/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-kube-api-access-zhnwr\") pod \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\" (UID: \"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6\") "
Nov 01 04:08:15.328050 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.328019    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-plugins-config-volume" pod "7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6" (UID: "7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:15.328300 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.328282    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:15.330908 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.330880    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-kube-api-access-zhnwr" pod "7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6" (UID: "7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6"). InnerVolumeSpecName "kube-api-access-zhnwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:15.341647 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.341622    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:08:15.411298 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.411266    5529 generic.go:356] "Generic (PLEG): container finished" podID="7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6" containerID="e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857" exitCode=0
Nov 01 04:08:15.411486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.411319    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"
Nov 01 04:08:15.411486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.411368    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m" event={"ID":"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6","Type":"ContainerDied","Data":"e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857"}
Nov 01 04:08:15.411486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.411421    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m" event={"ID":"7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6","Type":"ContainerDied","Data":"0bd3b2f8f40256afd381a28fb2d2e55feb1d75021d4820dc339ce431735d3636"}
Nov 01 04:08:15.411486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.411442    5529 scope.go:122] "RemoveContainer" containerID="e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857"
Nov 01 04:08:15.413107 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.413077    5529 generic.go:356] "Generic (PLEG): container finished" podID="f5c34aef-1da1-499f-85db-4ff4646bcc44" containerID="4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8" exitCode=0
Nov 01 04:08:15.413635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.413127    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"
Nov 01 04:08:15.413635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.413147    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf" event={"ID":"f5c34aef-1da1-499f-85db-4ff4646bcc44","Type":"ContainerDied","Data":"4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8"}
Nov 01 04:08:15.413635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.413222    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf" event={"ID":"f5c34aef-1da1-499f-85db-4ff4646bcc44","Type":"ContainerDied","Data":"e0b26b456103241dc5493d1e5d57b8e64a00d9d731c3f63a0b30ac86b8d39147"}
Nov 01 04:08:15.424274 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.424256    5529 scope.go:122] "RemoveContainer" containerID="e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857"
Nov 01 04:08:15.424591 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:15.424567    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857\": container with ID starting with e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857 not found: ID does not exist" containerID="e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857"
Nov 01 04:08:15.424659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.424599    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857"} err="failed to get container status \"e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857\": rpc error: code = NotFound desc = could not find container \"e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857\": container with ID starting with e37a8e39ea1e569b14048e718fbeb1fbe4de934e6fca9fe6ac66c0710ddad857 not found: ID does not exist"
Nov 01 04:08:15.424659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.424621    5529 scope.go:122] "RemoveContainer" containerID="4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8"
Nov 01 04:08:15.429091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.429062    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5c34aef-1da1-499f-85db-4ff4646bcc44-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5c34aef-1da1-499f-85db-4ff4646bcc44-plugins-config-volume\") pod \"f5c34aef-1da1-499f-85db-4ff4646bcc44\" (UID: \"f5c34aef-1da1-499f-85db-4ff4646bcc44\") "
Nov 01 04:08:15.429243 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.429153    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5c34aef-1da1-499f-85db-4ff4646bcc44-kube-api-access-6rvc8\" (UniqueName: \"kubernetes.io/projected/f5c34aef-1da1-499f-85db-4ff4646bcc44-kube-api-access-6rvc8\") pod \"f5c34aef-1da1-499f-85db-4ff4646bcc44\" (UID: \"f5c34aef-1da1-499f-85db-4ff4646bcc44\") "
Nov 01 04:08:15.429495 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.429475    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c34aef-1da1-499f-85db-4ff4646bcc44-plugins-config-volume" pod "f5c34aef-1da1-499f-85db-4ff4646bcc44" (UID: "f5c34aef-1da1-499f-85db-4ff4646bcc44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:15.429732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.429707    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhnwr\" (UniqueName: \"kubernetes.io/projected/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6-kube-api-access-zhnwr\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:15.429732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.429728    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5c34aef-1da1-499f-85db-4ff4646bcc44-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:15.431405 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.431379    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c34aef-1da1-499f-85db-4ff4646bcc44-kube-api-access-6rvc8" pod "f5c34aef-1da1-499f-85db-4ff4646bcc44" (UID: "f5c34aef-1da1-499f-85db-4ff4646bcc44"). InnerVolumeSpecName "kube-api-access-6rvc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:15.435910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.435887    5529 scope.go:122] "RemoveContainer" containerID="4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8"
Nov 01 04:08:15.436284 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:15.436259    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8\": container with ID starting with 4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8 not found: ID does not exist" containerID="4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8"
Nov 01 04:08:15.436375 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.436293    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8"} err="failed to get container status \"4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8\": rpc error: code = NotFound desc = could not find container \"4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8\": container with ID starting with 4aa6bae1313b92ceed36e8ccb73e069b3c21e43c7e3186f1b8998d148920b6b8 not found: ID does not exist"
Nov 01 04:08:15.531031 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.530944    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rvc8\" (UniqueName: \"kubernetes.io/projected/f5c34aef-1da1-499f-85db-4ff4646bcc44-kube-api-access-6rvc8\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:15.627523 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.627485    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"]
Nov 01 04:08:15.631114 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.631081    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-aab51f-6b57bcbcb7-7f29m"]
Nov 01 04:08:15.787325 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:15.787237    5529 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c34aef_1da1_499f_85db_4ff4646bcc44.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c34aef_1da1_499f_85db_4ff4646bcc44.slice/crio-e0b26b456103241dc5493d1e5d57b8e64a00d9d731c3f63a0b30ac86b8d39147\": RecentStats: unable to find data in memory cache]"
Nov 01 04:08:15.836700 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.836660    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"]
Nov 01 04:08:15.840239 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:15.840210    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-aab51f-7ff7cc8587-jvwjf"]
Nov 01 04:08:16.134710 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:16.134678    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:16.337894 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:16.337865    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:17.376371 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:17.376338    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6" path="/var/lib/kubelet/pods/7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6/volumes"
Nov 01 04:08:17.376883 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:17.376866    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5c34aef-1da1-499f-85db-4ff4646bcc44" path="/var/lib/kubelet/pods/f5c34aef-1da1-499f-85db-4ff4646bcc44/volumes"
Nov 01 04:08:17.995927 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:17.995897    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"]
Nov 01 04:08:17.996130 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:17.996109    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22" podUID="9c72ef2b-6af0-44f3-8104-a0758f0b0e03" containerName="maas-api" containerID="cri-o://a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6" gracePeriod=30
Nov 01 04:08:18.057047 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.056989    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22" podUID="9c72ef2b-6af0-44f3-8104-a0758f0b0e03" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.73:8443/health\": dial tcp 10.133.0.73:8443: connect: connection refused"
Nov 01 04:08:18.176894 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.176750    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:18.353195 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.353132    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:08:18.461669 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.461630    5529 generic.go:356] "Generic (PLEG): container finished" podID="9c72ef2b-6af0-44f3-8104-a0758f0b0e03" containerID="a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6" exitCode=0
Nov 01 04:08:18.462218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.461688    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"
Nov 01 04:08:18.462218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.461788    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22" event={"ID":"9c72ef2b-6af0-44f3-8104-a0758f0b0e03","Type":"ContainerDied","Data":"a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6"}
Nov 01 04:08:18.462218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.461837    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22" event={"ID":"9c72ef2b-6af0-44f3-8104-a0758f0b0e03","Type":"ContainerDied","Data":"c45bc4800ab4a460a066985d4d6e90a65fbebb0e4cf0629b683d789b3bbcef97"}
Nov 01 04:08:18.462218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.461862    5529 scope.go:122] "RemoveContainer" containerID="a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6"
Nov 01 04:08:18.472600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.472225    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-metrics-certs\") pod \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") "
Nov 01 04:08:18.472600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.472375    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-openshift-service-ca\") pod \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") "
Nov 01 04:08:18.472600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.472439    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-kube-api-access-p9vsj\" (UniqueName: \"kubernetes.io/projected/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-kube-api-access-p9vsj\") pod \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") "
Nov 01 04:08:18.472600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.472492    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls\") pod \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\" (UID: \"9c72ef2b-6af0-44f3-8104-a0758f0b0e03\") "
Nov 01 04:08:18.477192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.473851    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-openshift-service-ca" pod "9c72ef2b-6af0-44f3-8104-a0758f0b0e03" (UID: "9c72ef2b-6af0-44f3-8104-a0758f0b0e03"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:18.481336 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.479159    5529 scope.go:122] "RemoveContainer" containerID="a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6"
Nov 01 04:08:18.481336 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:18.479559    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6\": container with ID starting with a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6 not found: ID does not exist" containerID="a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6"
Nov 01 04:08:18.481336 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.479592    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6"} err="failed to get container status \"a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6\": rpc error: code = NotFound desc = could not find container \"a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6\": container with ID starting with a1def6311185a4e5cec9f0b6fc7551b71247e78c8c4ef86c4f9435abd9427dc6 not found: ID does not exist"
Nov 01 04:08:18.497209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.488639    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls" pod "9c72ef2b-6af0-44f3-8104-a0758f0b0e03" (UID: "9c72ef2b-6af0-44f3-8104-a0758f0b0e03"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:08:18.497209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.488659    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-metrics-certs" pod "9c72ef2b-6af0-44f3-8104-a0758f0b0e03" (UID: "9c72ef2b-6af0-44f3-8104-a0758f0b0e03"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:08:18.497209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.488767    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-kube-api-access-p9vsj" pod "9c72ef2b-6af0-44f3-8104-a0758f0b0e03" (UID: "9c72ef2b-6af0-44f3-8104-a0758f0b0e03"). InnerVolumeSpecName "kube-api-access-p9vsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:18.577279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.576488    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:18.577279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.576533    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:18.577279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.576562    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9vsj\" (UniqueName: \"kubernetes.io/projected/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-kube-api-access-p9vsj\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:18.577279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.576578    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c72ef2b-6af0-44f3-8104-a0758f0b0e03-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:18.891207 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.891155    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"]
Nov 01 04:08:18.895221 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:18.895183    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-078e0d65-6588697649-gft22"]
Nov 01 04:08:19.375714 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:19.375689    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c72ef2b-6af0-44f3-8104-a0758f0b0e03" path="/var/lib/kubelet/pods/9c72ef2b-6af0-44f3-8104-a0758f0b0e03/volumes"
Nov 01 04:08:19.509928 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:19.509894    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:19.715701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:19.715596    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:19.994083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:19.993961    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:20.027344 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.027312    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"]
Nov 01 04:08:20.028296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028272    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f5c34aef-1da1-499f-85db-4ff4646bcc44" containerName="payload-pre-processing"
Nov 01 04:08:20.028296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028297    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5c34aef-1da1-499f-85db-4ff4646bcc44" containerName="payload-pre-processing"
Nov 01 04:08:20.028484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028346    5529 cpu_manager.go:414] "containerMap: removing container" podUID="9c72ef2b-6af0-44f3-8104-a0758f0b0e03" containerName="maas-api"
Nov 01 04:08:20.028484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028355    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c72ef2b-6af0-44f3-8104-a0758f0b0e03" containerName="maas-api"
Nov 01 04:08:20.028484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028409    5529 cpu_manager.go:414] "containerMap: removing container" podUID="7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6" containerName="payload-processing"
Nov 01 04:08:20.028484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028417    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6" containerName="payload-processing"
Nov 01 04:08:20.028688 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028554    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="7be4fb7d-64ba-4f6b-8c4b-2f630323f1a6" containerName="payload-processing"
Nov 01 04:08:20.028688 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028569    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5c34aef-1da1-499f-85db-4ff4646bcc44" containerName="payload-pre-processing"
Nov 01 04:08:20.028688 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.028583    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c72ef2b-6af0-44f3-8104-a0758f0b0e03" containerName="maas-api"
Nov 01 04:08:20.048216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.034504    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:20.096181 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.089528    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-fb1c1f-dockercfg-x8lls\""
Nov 01 04:08:20.096181 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.096059    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"]
Nov 01 04:08:20.134679 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.126650    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpr8\" (UniqueName: \"kubernetes.io/projected/07739fcc-12ec-471b-a529-750e9c43bc47-kube-api-access-wtpr8\") pod \"payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7\" (UID: \"07739fcc-12ec-471b-a529-750e9c43bc47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:20.134679 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.126756    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07739fcc-12ec-471b-a529-750e9c43bc47-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7\" (UID: \"07739fcc-12ec-471b-a529-750e9c43bc47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:20.135787 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.135594    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-fb1c1f\""
Nov 01 04:08:20.184267 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.184188    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"]
Nov 01 04:08:20.189670 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.189645    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:20.235352 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.227496    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:20.236122 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.231042    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpr8\" (UniqueName: \"kubernetes.io/projected/07739fcc-12ec-471b-a529-750e9c43bc47-kube-api-access-wtpr8\") pod \"payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7\" (UID: \"07739fcc-12ec-471b-a529-750e9c43bc47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:20.236462 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.236437    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07739fcc-12ec-471b-a529-750e9c43bc47-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7\" (UID: \"07739fcc-12ec-471b-a529-750e9c43bc47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:20.237571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.237547    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07739fcc-12ec-471b-a529-750e9c43bc47-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7\" (UID: \"07739fcc-12ec-471b-a529-750e9c43bc47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:20.257712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.253783    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"]
Nov 01 04:08:20.294801 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.294764    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpr8\" (UniqueName: \"kubernetes.io/projected/07739fcc-12ec-471b-a529-750e9c43bc47-kube-api-access-wtpr8\") pod \"payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7\" (UID: \"07739fcc-12ec-471b-a529-750e9c43bc47\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:20.343932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.338498    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb\" (UID: \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:20.343932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.338902    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8jsv\" (UniqueName: \"kubernetes.io/projected/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-kube-api-access-n8jsv\") pod \"payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb\" (UID: \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:20.392342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.392293    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:20.442183 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.440905    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8jsv\" (UniqueName: \"kubernetes.io/projected/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-kube-api-access-n8jsv\") pod \"payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb\" (UID: \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:20.442183 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.441006    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb\" (UID: \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:20.442464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.442388    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb\" (UID: \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:20.449539 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.449458    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:20.508106 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.508033    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8jsv\" (UniqueName: \"kubernetes.io/projected/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-kube-api-access-n8jsv\") pod \"payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb\" (UID: \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:20.532439 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.532412    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:20.803312 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.803284    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"]
Nov 01 04:08:20.805324 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:08:20.805292    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07739fcc_12ec_471b_a529_750e9c43bc47.slice/crio-1ff24916c82e6d185a531fcd99945a02e7353df3c79eec96cafd8489e78e1331 WatchSource:0}: Error finding container 1ff24916c82e6d185a531fcd99945a02e7353df3c79eec96cafd8489e78e1331: Status 404 returned error can't find the container with id 1ff24916c82e6d185a531fcd99945a02e7353df3c79eec96cafd8489e78e1331
Nov 01 04:08:20.932474 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:20.932446    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"]
Nov 01 04:08:20.934085 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:08:20.934053    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfc6927_b1e8_4b84_a9b7_df730fdffc5a.slice/crio-e10d66b3931a06aa1e6ee670486965917617742c4b8f26c079eb07b8f5e1766b WatchSource:0}: Error finding container e10d66b3931a06aa1e6ee670486965917617742c4b8f26c079eb07b8f5e1766b: Status 404 returned error can't find the container with id e10d66b3931a06aa1e6ee670486965917617742c4b8f26c079eb07b8f5e1766b
Nov 01 04:08:21.494796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:21.494754    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7" event={"ID":"07739fcc-12ec-471b-a529-750e9c43bc47","Type":"ContainerStarted","Data":"3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5"}
Nov 01 04:08:21.494995 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:21.494813    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7" event={"ID":"07739fcc-12ec-471b-a529-750e9c43bc47","Type":"ContainerStarted","Data":"1ff24916c82e6d185a531fcd99945a02e7353df3c79eec96cafd8489e78e1331"}
Nov 01 04:08:21.494995 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:21.494842    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:21.496538 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:21.496508    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb" event={"ID":"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a","Type":"ContainerStarted","Data":"b3c3480695639f2e7fc694ff841c2fe0615d7df20d7e3ad4cf3779c887bc6c52"}
Nov 01 04:08:21.496675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:21.496571    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:21.496675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:21.496594    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb" event={"ID":"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a","Type":"ContainerStarted","Data":"e10d66b3931a06aa1e6ee670486965917617742c4b8f26c079eb07b8f5e1766b"}
Nov 01 04:08:21.616756 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:21.616691    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7" podStartSLOduration=2.616671386 podStartE2EDuration="2.616671386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:08:21.611259316 +0000 UTC m=+1522.370987110" watchObservedRunningTime="2026-11-01 04:08:21.616671386 +0000 UTC m=+1522.376399184"
Nov 01 04:08:21.742525 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:21.739129    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb" podStartSLOduration=1.73910373 podStartE2EDuration="1.73910373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:08:21.727906067 +0000 UTC m=+1522.487633874" watchObservedRunningTime="2026-11-01 04:08:21.73910373 +0000 UTC m=+1522.498831522"
Nov 01 04:08:24.468868 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:24.468830    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:24.809371 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:24.809287    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:26.426555 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:26.426515    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:26.705603 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:26.705520    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:26.918901 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:26.918855    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:27.352797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:27.352756    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:32.072603 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:32.072564    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:32.351392 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:32.351294    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:32.506524 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:32.506495    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:08:32.506708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:32.506570    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:08:32.545912 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:32.545885    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:33.442293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:33.442261    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:33.646486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:33.646438    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:33.865861 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:33.865755    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:34.639091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:34.639054    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:34.848941 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:34.848908    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:37.595462 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:37.595422    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:42.622814 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:42.622752    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:42.825774 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:42.825742    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:43.025584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:43.025556    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:44.285473 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:44.285437    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:08:46.458266 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:46.458228    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"]
Nov 01 04:08:46.565604 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:46.565562    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"]
Nov 01 04:08:46.889825 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:46.889788    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:47.088313 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:47.088285    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:47.694262 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:47.694231    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"]
Nov 01 04:08:47.694765 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:47.694467    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" containerID="cri-o://ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c" gracePeriod=30
Nov 01 04:08:47.698561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:47.698531    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"]
Nov 01 04:08:47.698758 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:47.698720    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy" containerID="cri-o://16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57" gracePeriod=30
Nov 01 04:08:47.725620 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:47.725581    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:50.961046 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:50.961006    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"]
Nov 01 04:08:50.961571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:50.961297    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy" containerID="cri-o://2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead" gracePeriod=30
Nov 01 04:08:51.459279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.459230    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk" podUID="375adffa-569f-43c7-9324-f36225c86031" containerName="payload-processing" containerID="cri-o://c141b181a822f16b106f34362be2532f893962d1125bd6e36c31e50963e079ef" gracePeriod=25
Nov 01 04:08:51.566926 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.566866    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f" podUID="23c6e165-eb44-40d6-b383-15d58b0f7a0a" containerName="payload-pre-processing" containerID="cri-o://63783479e78d003bc846bf8a78d6d9f402e22d2137e491af383557b8c7820a26" gracePeriod=25
Nov 01 04:08:51.754159 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.754118    5529 generic.go:356] "Generic (PLEG): container finished" podID="23c6e165-eb44-40d6-b383-15d58b0f7a0a" containerID="63783479e78d003bc846bf8a78d6d9f402e22d2137e491af383557b8c7820a26" exitCode=0
Nov 01 04:08:51.755529 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.755409    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f" event={"ID":"23c6e165-eb44-40d6-b383-15d58b0f7a0a","Type":"ContainerDied","Data":"63783479e78d003bc846bf8a78d6d9f402e22d2137e491af383557b8c7820a26"}
Nov 01 04:08:51.758464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.758123    5529 generic.go:356] "Generic (PLEG): container finished" podID="375adffa-569f-43c7-9324-f36225c86031" containerID="c141b181a822f16b106f34362be2532f893962d1125bd6e36c31e50963e079ef" exitCode=0
Nov 01 04:08:51.758464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.758343    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk" event={"ID":"375adffa-569f-43c7-9324-f36225c86031","Type":"ContainerDied","Data":"c141b181a822f16b106f34362be2532f893962d1125bd6e36c31e50963e079ef"}
Nov 01 04:08:51.758464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.758388    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk" event={"ID":"375adffa-569f-43c7-9324-f36225c86031","Type":"ContainerDied","Data":"ad72cdff60defdfe0ce01b20db10fd365b243d59238d8580b30909b08468dc37"}
Nov 01 04:08:51.758464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.758411    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad72cdff60defdfe0ce01b20db10fd365b243d59238d8580b30909b08468dc37"
Nov 01 04:08:51.767001 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.766720    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:08:51.858223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.858197    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:08:51.860431 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.860407    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/375adffa-569f-43c7-9324-f36225c86031-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/375adffa-569f-43c7-9324-f36225c86031-plugins-config-volume\") pod \"375adffa-569f-43c7-9324-f36225c86031\" (UID: \"375adffa-569f-43c7-9324-f36225c86031\") "
Nov 01 04:08:51.860682 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.860667    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/375adffa-569f-43c7-9324-f36225c86031-kube-api-access-nfw67\" (UniqueName: \"kubernetes.io/projected/375adffa-569f-43c7-9324-f36225c86031-kube-api-access-nfw67\") pod \"375adffa-569f-43c7-9324-f36225c86031\" (UID: \"375adffa-569f-43c7-9324-f36225c86031\") "
Nov 01 04:08:51.860879 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.860852    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/375adffa-569f-43c7-9324-f36225c86031-plugins-config-volume" pod "375adffa-569f-43c7-9324-f36225c86031" (UID: "375adffa-569f-43c7-9324-f36225c86031"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:51.861267 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.861246    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/375adffa-569f-43c7-9324-f36225c86031-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:51.862730 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.862711    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375adffa-569f-43c7-9324-f36225c86031-kube-api-access-nfw67" pod "375adffa-569f-43c7-9324-f36225c86031" (UID: "375adffa-569f-43c7-9324-f36225c86031"). InnerVolumeSpecName "kube-api-access-nfw67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:51.962416 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.962375    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23c6e165-eb44-40d6-b383-15d58b0f7a0a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23c6e165-eb44-40d6-b383-15d58b0f7a0a-plugins-config-volume\") pod \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\" (UID: \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\") "
Nov 01 04:08:51.962837 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.962515    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23c6e165-eb44-40d6-b383-15d58b0f7a0a-kube-api-access-qkzhd\" (UniqueName: \"kubernetes.io/projected/23c6e165-eb44-40d6-b383-15d58b0f7a0a-kube-api-access-qkzhd\") pod \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\" (UID: \"23c6e165-eb44-40d6-b383-15d58b0f7a0a\") "
Nov 01 04:08:51.962837 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.962804    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c6e165-eb44-40d6-b383-15d58b0f7a0a-plugins-config-volume" pod "23c6e165-eb44-40d6-b383-15d58b0f7a0a" (UID: "23c6e165-eb44-40d6-b383-15d58b0f7a0a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:51.963060 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.963043    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23c6e165-eb44-40d6-b383-15d58b0f7a0a-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:51.963142 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.963062    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfw67\" (UniqueName: \"kubernetes.io/projected/375adffa-569f-43c7-9324-f36225c86031-kube-api-access-nfw67\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:51.964690 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:51.964668    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c6e165-eb44-40d6-b383-15d58b0f7a0a-kube-api-access-qkzhd" pod "23c6e165-eb44-40d6-b383-15d58b0f7a0a" (UID: "23c6e165-eb44-40d6-b383-15d58b0f7a0a"). InnerVolumeSpecName "kube-api-access-qkzhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:52.064016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.063939    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkzhd\" (UniqueName: \"kubernetes.io/projected/23c6e165-eb44-40d6-b383-15d58b0f7a0a-kube-api-access-qkzhd\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:52.413286 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.413251    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"]
Nov 01 04:08:52.413480 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.413460    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy" containerID="cri-o://6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4" gracePeriod=30
Nov 01 04:08:52.424578 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.424543    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 01 04:08:52.424713 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.424598    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 01 04:08:52.718265 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.718123    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:52.779882 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.779856    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"
Nov 01 04:08:52.780088 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.780066    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"
Nov 01 04:08:52.780256 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.779867    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f" event={"ID":"23c6e165-eb44-40d6-b383-15d58b0f7a0a","Type":"ContainerDied","Data":"4d867b8269ec34f93c06eadfbd28f86dc04a82f61354527628626606a4ae4a92"}
Nov 01 04:08:52.780338 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:52.780276    5529 scope.go:122] "RemoveContainer" containerID="63783479e78d003bc846bf8a78d6d9f402e22d2137e491af383557b8c7820a26"
Nov 01 04:08:53.003046 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.003017    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"]
Nov 01 04:08:53.006673 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.006645    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3344e8-6c5b66759f-xcskk"]
Nov 01 04:08:53.031817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.031792    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:08:53.034669 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.034649    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:08:53.076950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.076919    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-credential-socket\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.077120 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.076971    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-certs\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.077120 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077010    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/614d06dd-0135-4003-99a6-3513d4c71726-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/614d06dd-0135-4003-99a6-3513d4c71726-istio-podinfo\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.077120 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077029    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-certs\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.077120 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077063    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-envoy\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.077380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077123    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-credential-socket\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.077380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077149    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-podinfo\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.077380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077250    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-token\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-token\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.077380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077286    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-kube-api-access-cn5hd\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-kube-api-access-cn5hd\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.077380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077319    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-credential-socket" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.077380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077330    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-certs" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.077380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077334    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-certs" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.077701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077520    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-credential-socket" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.077764 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077722    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/614d06dd-0135-4003-99a6-3513d4c71726-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/614d06dd-0135-4003-99a6-3513d4c71726-istiod-ca-cert\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.077821 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077759    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/148fa319-e0e0-4d1a-8958-6d71e0558568-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/148fa319-e0e0-4d1a-8958-6d71e0558568-istiod-ca-cert\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.077872 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077858    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-socket\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.077975 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.077954    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-istio-token\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-istio-token\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.078053 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078012    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-data\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.078053 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078043    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-kube-api-access-8slvj\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-kube-api-access-8slvj\") pod \"148fa319-e0e0-4d1a-8958-6d71e0558568\" (UID: \"148fa319-e0e0-4d1a-8958-6d71e0558568\") "
Nov 01 04:08:53.078159 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078125    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-socket" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.078159 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078146    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/614d06dd-0135-4003-99a6-3513d4c71726-istiod-ca-cert" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:53.078296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078223    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/148fa319-e0e0-4d1a-8958-6d71e0558568-istiod-ca-cert" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:53.078349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078318    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-data" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.078410 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078081    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-socket\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.078476 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078415    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-envoy\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.078656 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078631    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-socket" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.078766 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078745    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-data\") pod \"614d06dd-0135-4003-99a6-3513d4c71726\" (UID: \"614d06dd-0135-4003-99a6-3513d4c71726\") "
Nov 01 04:08:53.078874 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.078849    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-data" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079432    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/614d06dd-0135-4003-99a6-3513d4c71726-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079461    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/148fa319-e0e0-4d1a-8958-6d71e0558568-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079476    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079493    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079509    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079523    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079538    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079551    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079565    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.079619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079578    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.080494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.079879    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-envoy" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.080494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.080247    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-podinfo" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:08:53.080494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.080356    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/614d06dd-0135-4003-99a6-3513d4c71726-istio-podinfo" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:08:53.080494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.080361    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-token" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:53.080627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.080575    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-kube-api-access-cn5hd" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "kube-api-access-cn5hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:53.080855 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.080834    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-envoy" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:53.081226 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.081209    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-istio-token" pod "614d06dd-0135-4003-99a6-3513d4c71726" (UID: "614d06dd-0135-4003-99a6-3513d4c71726"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:53.081675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.081656    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-kube-api-access-8slvj" pod "148fa319-e0e0-4d1a-8958-6d71e0558568" (UID: "148fa319-e0e0-4d1a-8958-6d71e0558568"). InnerVolumeSpecName "kube-api-access-8slvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:53.117015 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.116980    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"]
Nov 01 04:08:53.121887 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.121856    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-3344e8-7b57f5659f-cqz6f"]
Nov 01 04:08:53.181194 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.181145    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.181194 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.181195    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.181401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.181212    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn5hd\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-kube-api-access-cn5hd\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.181401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.181225    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/614d06dd-0135-4003-99a6-3513d4c71726-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.181401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.181234    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8slvj\" (UniqueName: \"kubernetes.io/projected/148fa319-e0e0-4d1a-8958-6d71e0558568-kube-api-access-8slvj\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.181401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.181243    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/614d06dd-0135-4003-99a6-3513d4c71726-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.181401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.181251    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/614d06dd-0135-4003-99a6-3513d4c71726-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.181401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.181261    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/148fa319-e0e0-4d1a-8958-6d71e0558568-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:53.377277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.377245    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23c6e165-eb44-40d6-b383-15d58b0f7a0a" path="/var/lib/kubelet/pods/23c6e165-eb44-40d6-b383-15d58b0f7a0a/volumes"
Nov 01 04:08:53.377922 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.377902    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="375adffa-569f-43c7-9324-f36225c86031" path="/var/lib/kubelet/pods/375adffa-569f-43c7-9324-f36225c86031/volumes"
Nov 01 04:08:53.789553 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.789462    5529 generic.go:356] "Generic (PLEG): container finished" podID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerID="ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c" exitCode=0
Nov 01 04:08:53.789553 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.789506    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"
Nov 01 04:08:53.789553 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.789535    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" event={"ID":"148fa319-e0e0-4d1a-8958-6d71e0558568","Type":"ContainerDied","Data":"ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c"}
Nov 01 04:08:53.789846 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.789584    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc" event={"ID":"148fa319-e0e0-4d1a-8958-6d71e0558568","Type":"ContainerDied","Data":"663a733da93eb318da3fd08af5d64d18920112d0764bcf3a80e83e4f86730558"}
Nov 01 04:08:53.789846 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.789609    5529 scope.go:122] "RemoveContainer" containerID="ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c"
Nov 01 04:08:53.791153 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.791121    5529 generic.go:356] "Generic (PLEG): container finished" podID="614d06dd-0135-4003-99a6-3513d4c71726" containerID="16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57" exitCode=0
Nov 01 04:08:53.791283 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.791185    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"
Nov 01 04:08:53.791283 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.791221    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" event={"ID":"614d06dd-0135-4003-99a6-3513d4c71726","Type":"ContainerDied","Data":"16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57"}
Nov 01 04:08:53.791389 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.791288    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" event={"ID":"614d06dd-0135-4003-99a6-3513d4c71726","Type":"ContainerDied","Data":"7f1de829a23ef97311b56bc0b34dcf138380b695e58b9787fc4bf46f0c405d3c"}
Nov 01 04:08:53.813351 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.812328    5529 scope.go:122] "RemoveContainer" containerID="ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c"
Nov 01 04:08:53.817185 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:53.815259    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c\": container with ID starting with ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c not found: ID does not exist" containerID="ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c"
Nov 01 04:08:53.817185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.815304    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c"} err="failed to get container status \"ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c\": rpc error: code = NotFound desc = could not find container \"ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c\": container with ID starting with ed3e4163b5239004e79ca6585a722a846730505179a32cc2dde80df40787409c not found: ID does not exist"
Nov 01 04:08:53.817185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.815330    5529 scope.go:122] "RemoveContainer" containerID="16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57"
Nov 01 04:08:53.831092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.831068    5529 scope.go:122] "RemoveContainer" containerID="16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57"
Nov 01 04:08:53.831512 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:53.831489    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57\": container with ID starting with 16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57 not found: ID does not exist" containerID="16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57"
Nov 01 04:08:53.831616 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.831528    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57"} err="failed to get container status \"16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57\": rpc error: code = NotFound desc = could not find container \"16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57\": container with ID starting with 16152683c44bca4b44ac256f71d967cd0799dd00ef535b254f96f6127addcc57 not found: ID does not exist"
Nov 01 04:08:53.941561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.941525    5529 patch_prober.go:29] interesting pod/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 04:08:53.941739 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.941586    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:08:53.993779 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:53.993746    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"]
Nov 01 04:08:54.046134 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:54.046054    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-hqf6w"]
Nov 01 04:08:54.157138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:54.157107    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"]
Nov 01 04:08:54.161623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:54.161600    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-9vgsc"]
Nov 01 04:08:55.375066 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:55.375035    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" path="/var/lib/kubelet/pods/148fa319-e0e0-4d1a-8958-6d71e0558568/volumes"
Nov 01 04:08:55.375646 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:55.375625    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="614d06dd-0135-4003-99a6-3513d4c71726" path="/var/lib/kubelet/pods/614d06dd-0135-4003-99a6-3513d4c71726/volumes"
Nov 01 04:08:56.050365 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.050320    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Nov 01 04:08:56.050550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.050406    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Nov 01 04:08:56.230757 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.230696    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:08:56.324444 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324407    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-podinfo\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.324623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324501    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-kube-api-access-lbt4l\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-kube-api-access-lbt4l\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.324623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324536    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-certs\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.324623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324596    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-token\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-token\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.324736 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324685    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-envoy\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.324736 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324709    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-data\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.324805 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324786    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-credential-socket\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.324864 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324820    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-socket\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.324864 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.324846    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/861b2fd5-3a2d-4962-8382-3cade14efe57-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861b2fd5-3a2d-4962-8382-3cade14efe57-istiod-ca-cert\") pod \"861b2fd5-3a2d-4962-8382-3cade14efe57\" (UID: \"861b2fd5-3a2d-4962-8382-3cade14efe57\") "
Nov 01 04:08:56.325214 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.325181    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-certs" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:56.325491 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.325415    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-data" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:56.325593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.325579    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-credential-socket" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:56.325992 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.325965    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/861b2fd5-3a2d-4962-8382-3cade14efe57-istiod-ca-cert" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:56.326118 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.326039    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-socket" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:56.326800 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.326777    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.327002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.326929    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.327002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.326954    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.327002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.326970    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.327002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.326992    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/861b2fd5-3a2d-4962-8382-3cade14efe57-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.327369 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.327114    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-token" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:56.327429 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.327402    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-kube-api-access-lbt4l" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "kube-api-access-lbt4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:56.327613 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.327586    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-podinfo" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:08:56.327937 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.327919    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-envoy" pod "861b2fd5-3a2d-4962-8382-3cade14efe57" (UID: "861b2fd5-3a2d-4962-8382-3cade14efe57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:56.429042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.429005    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.429042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.429045    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.429479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.429059    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/861b2fd5-3a2d-4962-8382-3cade14efe57-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.429479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.429074    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbt4l\" (UniqueName: \"kubernetes.io/projected/861b2fd5-3a2d-4962-8382-3cade14efe57-kube-api-access-lbt4l\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:56.818989 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.818953    5529 generic.go:356] "Generic (PLEG): container finished" podID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerID="2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead" exitCode=0
Nov 01 04:08:56.819221 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.819003    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"
Nov 01 04:08:56.819221 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.819033    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" event={"ID":"861b2fd5-3a2d-4962-8382-3cade14efe57","Type":"ContainerDied","Data":"2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead"}
Nov 01 04:08:56.819221 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.819093    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4" event={"ID":"861b2fd5-3a2d-4962-8382-3cade14efe57","Type":"ContainerDied","Data":"8f5668101a22c8c16a5bc8e09d9670dbc3429b108d08561bf98e1016f3093ccb"}
Nov 01 04:08:56.819221 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.819118    5529 scope.go:122] "RemoveContainer" containerID="2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead"
Nov 01 04:08:56.832421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.832394    5529 scope.go:122] "RemoveContainer" containerID="2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead"
Nov 01 04:08:56.832732 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:56.832706    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead\": container with ID starting with 2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead not found: ID does not exist" containerID="2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead"
Nov 01 04:08:56.832818 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.832744    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead"} err="failed to get container status \"2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead\": rpc error: code = NotFound desc = could not find container \"2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead\": container with ID starting with 2002b400c94a895e0339d78cc9362a5e1405b857ddf6339b51df23f9bfb5cead not found: ID does not exist"
Nov 01 04:08:56.988945 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.988913    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"]
Nov 01 04:08:56.994018 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:56.993992    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-kcwr4"]
Nov 01 04:08:57.209224 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.209184    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 01 04:08:57.209408 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.209266    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 01 04:08:57.374681 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.374646    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" path="/var/lib/kubelet/pods/861b2fd5-3a2d-4962-8382-3cade14efe57/volumes"
Nov 01 04:08:57.672636 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.672603    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:08:57.725235 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.725053    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:08:57.746333 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746299    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-certs\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.746545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746377    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-envoy\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.746615 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746551    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-credential-socket\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.746615 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746583    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-podinfo\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.746734 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746616    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-certs" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:57.746734 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746632    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-kube-api-access-4mn52\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-kube-api-access-4mn52\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.746834 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746811    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-data\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.746895 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746871    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-socket\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.747318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746938    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istiod-ca-cert\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.747318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.746999    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-token\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-token\") pod \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\" (UID: \"25cd1de7-c5dc-41e8-bdfc-96bfda674b88\") "
Nov 01 04:08:57.747318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.747239    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-data" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:57.747318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.747290    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-socket" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:57.747549 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.747426    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istiod-ca-cert" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:08:57.747726 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.747692    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-credential-socket" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:57.747726 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.747713    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.747879 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.747734    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.747879 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.747748    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.747879 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.747761    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.749186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.749147    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-envoy" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:08:57.749577 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.749547    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-token" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:57.749932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.749909    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-podinfo" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:08:57.750576 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.750551    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-kube-api-access-4mn52" pod "25cd1de7-c5dc-41e8-bdfc-96bfda674b88" (UID: "25cd1de7-c5dc-41e8-bdfc-96bfda674b88"). InnerVolumeSpecName "kube-api-access-4mn52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:08:57.836587 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.836494    5529 generic.go:356] "Generic (PLEG): container finished" podID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerID="6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4" exitCode=0
Nov 01 04:08:57.836770 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.836637    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" event={"ID":"25cd1de7-c5dc-41e8-bdfc-96bfda674b88","Type":"ContainerDied","Data":"6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4"}
Nov 01 04:08:57.836770 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.836691    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k" event={"ID":"25cd1de7-c5dc-41e8-bdfc-96bfda674b88","Type":"ContainerDied","Data":"aa37fbf64bb5ecd89ceeeebefb193f5c551c2ea1c9e57529283e75fa339b7b1d"}
Nov 01 04:08:57.836770 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.836718    5529 scope.go:122] "RemoveContainer" containerID="6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4"
Nov 01 04:08:57.836924 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.836826    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"
Nov 01 04:08:57.849548 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.849517    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mn52\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-kube-api-access-4mn52\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.849714 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.849699    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.849806 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.849795    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.849903 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.849883    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.850005 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.849906    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25cd1de7-c5dc-41e8-bdfc-96bfda674b88-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:08:57.854793 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.854774    5529 scope.go:122] "RemoveContainer" containerID="6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4"
Nov 01 04:08:57.855128 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:08:57.855103    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4\": container with ID starting with 6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4 not found: ID does not exist" containerID="6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4"
Nov 01 04:08:57.855227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:57.855140    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4"} err="failed to get container status \"6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4\": rpc error: code = NotFound desc = could not find container \"6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4\": container with ID starting with 6a6fd8cbf3152624f0181a014b7fc6e2def64ac4a43b780afa4602f96d7e6cc4 not found: ID does not exist"
Nov 01 04:08:58.009138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:58.009101    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"]
Nov 01 04:08:58.019194 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:58.019134    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-pp85k"]
Nov 01 04:08:59.386990 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:08:59.386954    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" path="/var/lib/kubelet/pods/25cd1de7-c5dc-41e8-bdfc-96bfda674b88/volumes"
Nov 01 04:09:02.731403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:02.731371    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:07.714399 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:07.714365    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:09.964087 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:09.964051    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:12.739923 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:12.739892    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:14.285833 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:09:14.285794    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:09:17.376632 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.376606    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"]
Nov 01 04:09:17.377197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377183    5529 cpu_manager.go:414] "containerMap: removing container" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy"
Nov 01 04:09:17.377253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377199    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy"
Nov 01 04:09:17.377253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377227    5529 cpu_manager.go:414] "containerMap: removing container" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy"
Nov 01 04:09:17.377253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377232    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy"
Nov 01 04:09:17.377368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377254    5529 cpu_manager.go:414] "containerMap: removing container" podUID="375adffa-569f-43c7-9324-f36225c86031" containerName="payload-processing"
Nov 01 04:09:17.377368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377259    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="375adffa-569f-43c7-9324-f36225c86031" containerName="payload-processing"
Nov 01 04:09:17.377368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377267    5529 cpu_manager.go:414] "containerMap: removing container" podUID="23c6e165-eb44-40d6-b383-15d58b0f7a0a" containerName="payload-pre-processing"
Nov 01 04:09:17.377368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377274    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23c6e165-eb44-40d6-b383-15d58b0f7a0a" containerName="payload-pre-processing"
Nov 01 04:09:17.377368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377286    5529 cpu_manager.go:414] "containerMap: removing container" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy"
Nov 01 04:09:17.377368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377293    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy"
Nov 01 04:09:17.377368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377307    5529 cpu_manager.go:414] "containerMap: removing container" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy"
Nov 01 04:09:17.377368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377315    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy"
Nov 01 04:09:17.377712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377477    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="375adffa-569f-43c7-9324-f36225c86031" containerName="payload-processing"
Nov 01 04:09:17.377712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377495    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="23c6e165-eb44-40d6-b383-15d58b0f7a0a" containerName="payload-pre-processing"
Nov 01 04:09:17.377712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377510    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="861b2fd5-3a2d-4962-8382-3cade14efe57" containerName="istio-proxy"
Nov 01 04:09:17.377712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377525    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="25cd1de7-c5dc-41e8-bdfc-96bfda674b88" containerName="istio-proxy"
Nov 01 04:09:17.377712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377542    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="614d06dd-0135-4003-99a6-3513d4c71726" containerName="istio-proxy"
Nov 01 04:09:17.377712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.377558    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="148fa319-e0e0-4d1a-8958-6d71e0558568" containerName="istio-proxy"
Nov 01 04:09:17.381833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.381812    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.438373 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.438333    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"]
Nov 01 04:09:17.482265 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.482231    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-fb1c1f-serving-cert\""
Nov 01 04:09:17.510450 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.510407    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8bd138-7977-4f68-9bd7-dfde9536315a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.510676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.510653    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.510799 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.510778    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-777fs\" (UniqueName: \"kubernetes.io/projected/ab8bd138-7977-4f68-9bd7-dfde9536315a-kube-api-access-777fs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.511060 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.511030    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.612815 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.612775    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-777fs\" (UniqueName: \"kubernetes.io/projected/ab8bd138-7977-4f68-9bd7-dfde9536315a-kube-api-access-777fs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.613018 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.612868    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.613018 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.612943    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8bd138-7977-4f68-9bd7-dfde9536315a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.613018 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:09:17.613002    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-serving-cert: secret "maas-api-e2e-shared-b-w2-fb1c1f-serving-cert" not found
Nov 01 04:09:17.613213 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:09:17.613084    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls podName:ab8bd138-7977-4f68-9bd7-dfde9536315a nodeName:}" failed. No retries permitted until 2026-11-01 04:09:18.113063453 +0000 UTC m=+1578.872791229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls") pod "maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj" (UID: "ab8bd138-7977-4f68-9bd7-dfde9536315a") : secret "maas-api-e2e-shared-b-w2-fb1c1f-serving-cert" not found
Nov 01 04:09:17.613213 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.613129    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.614081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.614048    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8bd138-7977-4f68-9bd7-dfde9536315a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.615597 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.615573    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.637553 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.637443    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:17.677653 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.677617    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-777fs\" (UniqueName: \"kubernetes.io/projected/ab8bd138-7977-4f68-9bd7-dfde9536315a-kube-api-access-777fs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:17.838021 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:17.837988    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:18.120822 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:18.120742    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:18.123258 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:18.123236    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:18.296931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:18.296894    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:18.678616 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:18.678496    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"]
Nov 01 04:09:18.680999 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:09:18.680968    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8bd138_7977_4f68_9bd7_dfde9536315a.slice/crio-f230dca2d3df18929fa7740f6bcbbf6394f9bee95d184cff7380f19767e59017 WatchSource:0}: Error finding container f230dca2d3df18929fa7740f6bcbbf6394f9bee95d184cff7380f19767e59017: Status 404 returned error can't find the container with id f230dca2d3df18929fa7740f6bcbbf6394f9bee95d184cff7380f19767e59017
Nov 01 04:09:18.999512 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:18.999409    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj" event={"ID":"ab8bd138-7977-4f68-9bd7-dfde9536315a","Type":"ContainerStarted","Data":"f230dca2d3df18929fa7740f6bcbbf6394f9bee95d184cff7380f19767e59017"}
Nov 01 04:09:19.957682 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:19.957647    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:20.009114 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:20.009022    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj" event={"ID":"ab8bd138-7977-4f68-9bd7-dfde9536315a","Type":"ContainerStarted","Data":"14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f"}
Nov 01 04:09:20.009311 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:20.009129    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:20.127867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:20.127801    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj" podStartSLOduration=2.084508986 podStartE2EDuration="3.127787861s" totalImagesPullingTime="1.043278875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:09:20.127113168 +0000 UTC m=+1580.886840964" watchObservedRunningTime="2026-11-01 04:09:20.127787861 +0000 UTC m=+1580.887515656"
Nov 01 04:09:22.627311 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:22.627269    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:22.832179 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:22.832134    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:23.041943 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:23.041845    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:26.022701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:26.022668    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:09:27.741884 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:27.741840    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:32.120405 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:32.120359    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:33.673944 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:33.673903    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:34.019064 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:34.018953    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:34.217782 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:34.217742    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:34.623781 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:34.623750    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:37.607209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:37.607135    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:37.801600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:37.801568    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:39.197581 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:39.197511    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:40.685219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:40.685181    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:40.903236 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:40.903199    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:41.130496 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:41.130439    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:44.287221 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:09:44.287173    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:09:44.442952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:44.442894    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:49.743781 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:49.743731    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:50.761180 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:50.761136    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:50.964844 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:50.964810    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:53.690817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:53.690784    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"]
Nov 01 04:09:53.988608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:53.988517    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:54.187862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:54.187829    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:54.548796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:54.548764    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:55.175071 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:55.175041    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:09:58.691997 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:58.691946    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g" podUID="09f87294-171e-4552-a626-06fb0832d350" containerName="payload-pre-processing" containerID="cri-o://b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48" gracePeriod=25
Nov 01 04:09:59.003532 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.003506    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:09:59.129463 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.129425    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09f87294-171e-4552-a626-06fb0832d350-kube-api-access-29qs9\" (UniqueName: \"kubernetes.io/projected/09f87294-171e-4552-a626-06fb0832d350-kube-api-access-29qs9\") pod \"09f87294-171e-4552-a626-06fb0832d350\" (UID: \"09f87294-171e-4552-a626-06fb0832d350\") "
Nov 01 04:09:59.129630 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.129565    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09f87294-171e-4552-a626-06fb0832d350-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09f87294-171e-4552-a626-06fb0832d350-plugins-config-volume\") pod \"09f87294-171e-4552-a626-06fb0832d350\" (UID: \"09f87294-171e-4552-a626-06fb0832d350\") "
Nov 01 04:09:59.130030 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.130003    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09f87294-171e-4552-a626-06fb0832d350-plugins-config-volume" pod "09f87294-171e-4552-a626-06fb0832d350" (UID: "09f87294-171e-4552-a626-06fb0832d350"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:09:59.130187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.130157    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09f87294-171e-4552-a626-06fb0832d350-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:09:59.131689 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.131666    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f87294-171e-4552-a626-06fb0832d350-kube-api-access-29qs9" pod "09f87294-171e-4552-a626-06fb0832d350" (UID: "09f87294-171e-4552-a626-06fb0832d350"). InnerVolumeSpecName "kube-api-access-29qs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:09:59.231598 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.231526    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29qs9\" (UniqueName: \"kubernetes.io/projected/09f87294-171e-4552-a626-06fb0832d350-kube-api-access-29qs9\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:09:59.319237 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.319205    5529 generic.go:356] "Generic (PLEG): container finished" podID="09f87294-171e-4552-a626-06fb0832d350" containerID="b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48" exitCode=0
Nov 01 04:09:59.319438 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.319257    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"
Nov 01 04:09:59.319438 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.319295    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g" event={"ID":"09f87294-171e-4552-a626-06fb0832d350","Type":"ContainerDied","Data":"b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48"}
Nov 01 04:09:59.319438 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.319352    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g" event={"ID":"09f87294-171e-4552-a626-06fb0832d350","Type":"ContainerDied","Data":"cb37d22fc82b7fec9a04da2be0ae7faf95d5191972b0a0a79449037fa16ac6fa"}
Nov 01 04:09:59.319438 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.319384    5529 scope.go:122] "RemoveContainer" containerID="b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48"
Nov 01 04:09:59.330245 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.330227    5529 scope.go:122] "RemoveContainer" containerID="b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48"
Nov 01 04:09:59.330566 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:09:59.330547    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48\": container with ID starting with b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48 not found: ID does not exist" containerID="b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48"
Nov 01 04:09:59.330633 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.330575    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48"} err="failed to get container status \"b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48\": rpc error: code = NotFound desc = could not find container \"b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48\": container with ID starting with b6ba2be08a4be7b549f2c4db77433b09c7e6daf74634bf47b03573291a024f48 not found: ID does not exist"
Nov 01 04:09:59.488022 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.487944    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"]
Nov 01 04:09:59.519680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:09:59.519643    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-6dd36b-7f576577d7-h942g"]
Nov 01 04:10:00.706673 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:00.706641    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:01.374425 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:01.374395    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09f87294-171e-4552-a626-06fb0832d350" path="/var/lib/kubelet/pods/09f87294-171e-4552-a626-06fb0832d350/volumes"
Nov 01 04:10:05.924332 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:05.924301    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:07.491886 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:07.491850    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"]
Nov 01 04:10:07.882685 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:07.882652    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:08.081534 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:08.081500    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:10.283490 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:10.283452    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:10.916256 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:10.916208    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:12.492618 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:12.492553    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92" podUID="81d60b83-4736-480b-9f4b-6d58afa39565" containerName="payload-processing" containerID="cri-o://95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4" gracePeriod=25
Nov 01 04:10:12.773761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:12.773734    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:10:12.921574 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:12.921537    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81d60b83-4736-480b-9f4b-6d58afa39565-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d60b83-4736-480b-9f4b-6d58afa39565-plugins-config-volume\") pod \"81d60b83-4736-480b-9f4b-6d58afa39565\" (UID: \"81d60b83-4736-480b-9f4b-6d58afa39565\") "
Nov 01 04:10:12.921762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:12.921671    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81d60b83-4736-480b-9f4b-6d58afa39565-kube-api-access-m259s\" (UniqueName: \"kubernetes.io/projected/81d60b83-4736-480b-9f4b-6d58afa39565-kube-api-access-m259s\") pod \"81d60b83-4736-480b-9f4b-6d58afa39565\" (UID: \"81d60b83-4736-480b-9f4b-6d58afa39565\") "
Nov 01 04:10:12.922044 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:12.922012    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d60b83-4736-480b-9f4b-6d58afa39565-plugins-config-volume" pod "81d60b83-4736-480b-9f4b-6d58afa39565" (UID: "81d60b83-4736-480b-9f4b-6d58afa39565"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:10:12.922330 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:12.922311    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81d60b83-4736-480b-9f4b-6d58afa39565-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:10:12.923839 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:12.923816    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d60b83-4736-480b-9f4b-6d58afa39565-kube-api-access-m259s" pod "81d60b83-4736-480b-9f4b-6d58afa39565" (UID: "81d60b83-4736-480b-9f4b-6d58afa39565"). InnerVolumeSpecName "kube-api-access-m259s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:10:13.023762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.023677    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m259s\" (UniqueName: \"kubernetes.io/projected/81d60b83-4736-480b-9f4b-6d58afa39565-kube-api-access-m259s\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:10:13.422667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.422634    5529 generic.go:356] "Generic (PLEG): container finished" podID="81d60b83-4736-480b-9f4b-6d58afa39565" containerID="95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4" exitCode=0
Nov 01 04:10:13.422837 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.422688    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"
Nov 01 04:10:13.422837 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.422715    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92" event={"ID":"81d60b83-4736-480b-9f4b-6d58afa39565","Type":"ContainerDied","Data":"95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4"}
Nov 01 04:10:13.422837 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.422779    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92" event={"ID":"81d60b83-4736-480b-9f4b-6d58afa39565","Type":"ContainerDied","Data":"1df2748b2eb8b1f4bf54721bd13859c25436a98e5ccd39326c17b00b60f9bc17"}
Nov 01 04:10:13.422837 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.422807    5529 scope.go:122] "RemoveContainer" containerID="95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4"
Nov 01 04:10:13.435768 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.435747    5529 scope.go:122] "RemoveContainer" containerID="95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4"
Nov 01 04:10:13.436178 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:10:13.436139    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4\": container with ID starting with 95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4 not found: ID does not exist" containerID="95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4"
Nov 01 04:10:13.436265 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.436224    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4"} err="failed to get container status \"95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4\": rpc error: code = NotFound desc = could not find container \"95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4\": container with ID starting with 95fbcd109a12e4fad310a7d05a38e6519a55cebec02b5ec08dd0581fa83301f4 not found: ID does not exist"
Nov 01 04:10:13.590139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.590109    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"]
Nov 01 04:10:13.640085 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:13.640000    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-78dad9-7c985bb45-49b92"]
Nov 01 04:10:14.284915 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:10:14.284877    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:10:15.374452 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:15.374415    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81d60b83-4736-480b-9f4b-6d58afa39565" path="/var/lib/kubelet/pods/81d60b83-4736-480b-9f4b-6d58afa39565/volumes"
Nov 01 04:10:15.909906 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:15.909876    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:20.285557 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:20.285525    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:20.899863 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:20.899818    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:25.897971 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:25.897931    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:26.523961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.523928    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"]
Nov 01 04:10:26.524592 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.524577    5529 cpu_manager.go:414] "containerMap: removing container" podUID="09f87294-171e-4552-a626-06fb0832d350" containerName="payload-pre-processing"
Nov 01 04:10:26.524644 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.524594    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09f87294-171e-4552-a626-06fb0832d350" containerName="payload-pre-processing"
Nov 01 04:10:26.524644 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.524620    5529 cpu_manager.go:414] "containerMap: removing container" podUID="81d60b83-4736-480b-9f4b-6d58afa39565" containerName="payload-processing"
Nov 01 04:10:26.524644 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.524625    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81d60b83-4736-480b-9f4b-6d58afa39565" containerName="payload-processing"
Nov 01 04:10:26.524744 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.524725    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="09f87294-171e-4552-a626-06fb0832d350" containerName="payload-pre-processing"
Nov 01 04:10:26.524744 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.524736    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="81d60b83-4736-480b-9f4b-6d58afa39565" containerName="payload-processing"
Nov 01 04:10:26.528484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.528464    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.580886 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.580851    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-078e0d65-openshift-default-dockercfg-dr25l\""
Nov 01 04:10:26.594564 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.594526    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.594564 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.594567    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2rs\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-kube-api-access-hn2rs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.594778 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.594714    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.594816 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.594776    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59930b46-2332-4b45-a280-87198e5067e9-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.594850 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.594820    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.594945 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.594927    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.594999 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.594974    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.595129 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.595074    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59930b46-2332-4b45-a280-87198e5067e9-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.595129 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.595103    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696054 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696018    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696071    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59930b46-2332-4b45-a280-87198e5067e9-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696092    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696158    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696195    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2rs\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-kube-api-access-hn2rs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696263    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696338    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59930b46-2332-4b45-a280-87198e5067e9-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696394    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696470    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696538    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696777 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696597    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696865 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696845    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696862    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59930b46-2332-4b45-a280-87198e5067e9-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.696925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.696896    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.698773 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.698747    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.699015 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.698998    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59930b46-2332-4b45-a280-87198e5067e9-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.729499 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.729462    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"]
Nov 01 04:10:26.758066 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.758030    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2rs\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-kube-api-access-hn2rs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.758543 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.758521    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:26.843558 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:26.843459    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:27.280018 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:27.279990    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"]
Nov 01 04:10:27.282290 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:10:27.282261    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59930b46_2332_4b45_a280_87198e5067e9.slice/crio-fc9c591b4918464e385316d4d076e16897af1987a14c0cfad26a8eca957a77c5 WatchSource:0}: Error finding container fc9c591b4918464e385316d4d076e16897af1987a14c0cfad26a8eca957a77c5: Status 404 returned error can't find the container with id fc9c591b4918464e385316d4d076e16897af1987a14c0cfad26a8eca957a77c5
Nov 01 04:10:27.285004 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:27.284961    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:27.285099 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:27.285034    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:27.285099 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:27.285066    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:27.531979 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:27.531870    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" event={"ID":"59930b46-2332-4b45-a280-87198e5067e9","Type":"ContainerStarted","Data":"90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec"}
Nov 01 04:10:27.531979 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:27.531935    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" event={"ID":"59930b46-2332-4b45-a280-87198e5067e9","Type":"ContainerStarted","Data":"fc9c591b4918464e385316d4d076e16897af1987a14c0cfad26a8eca957a77c5"}
Nov 01 04:10:27.656733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:27.656671    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" podStartSLOduration=1.656647867 podStartE2EDuration="1.656647867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:10:27.652180525 +0000 UTC m=+1648.411908318" watchObservedRunningTime="2026-11-01 04:10:27.656647867 +0000 UTC m=+1648.416375663"
Nov 01 04:10:27.843729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:27.843645    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:28.700060 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:28.700019    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:28.845627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:28.845591    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Nov 01 04:10:28.845832 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:28.845641    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Nov 01 04:10:29.844648 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:29.844603    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Nov 01 04:10:29.845204 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:29.844671    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Nov 01 04:10:30.847403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:30.847364    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Nov 01 04:10:30.847964 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:30.847933    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Nov 01 04:10:31.373094 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:31.373052    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:31.846609 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:31.846566    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Nov 01 04:10:31.846948 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:31.846902    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Nov 01 04:10:32.663188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:32.662769    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:32.848279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:32.848238    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Nov 01 04:10:32.848573 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:32.848544    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Nov 01 04:10:34.459409 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:34.459370    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:34.459960 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:34.459937    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:34.461118 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:34.461093    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:10:36.889716 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:36.889682    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:41.247946 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.247907    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:41.529950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.529840    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"]
Nov 01 04:10:41.540395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.538810    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.619596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.619539    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"]
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.659953    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.660021    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.660054    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e325476-56be-4cf2-aaf2-6d04f04c4245-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.660092    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.660178    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.660231    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.660333    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l99fb\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-kube-api-access-l99fb\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.660379    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.660675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.660429    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.761842 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.761807    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.761870    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.761933    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.761995    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.762029    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e325476-56be-4cf2-aaf2-6d04f04c4245-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.762067    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.762151    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.762226    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.762330    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l99fb\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-kube-api-access-l99fb\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762485 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.762425    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.762545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.762483    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.763092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.763059    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e325476-56be-4cf2-aaf2-6d04f04c4245-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.763279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.763244    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.763408 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.763378    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.764669 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.764645    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.764758 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.764679    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.823691 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.823617    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.823691 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.823629    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l99fb\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-kube-api-access-l99fb\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:41.863180 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:41.863128    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:42.310280 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:42.310247    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"]
Nov 01 04:10:42.311551 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:10:42.311524    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e325476_56be_4cf2_aaf2_6d04f04c4245.slice/crio-1b23854181e8ae621ec22c139ed77270f2b75c587a9d175a5db50ca9eb6191b5 WatchSource:0}: Error finding container 1b23854181e8ae621ec22c139ed77270f2b75c587a9d175a5db50ca9eb6191b5: Status 404 returned error can't find the container with id 1b23854181e8ae621ec22c139ed77270f2b75c587a9d175a5db50ca9eb6191b5
Nov 01 04:10:42.314221 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:42.314159    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:42.314308 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:42.314258    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:42.314308 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:42.314290    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:42.677197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:42.677147    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" event={"ID":"8e325476-56be-4cf2-aaf2-6d04f04c4245","Type":"ContainerStarted","Data":"0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef"}
Nov 01 04:10:42.677403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:42.677223    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" event={"ID":"8e325476-56be-4cf2-aaf2-6d04f04c4245","Type":"ContainerStarted","Data":"1b23854181e8ae621ec22c139ed77270f2b75c587a9d175a5db50ca9eb6191b5"}
Nov 01 04:10:42.863644 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:42.863612    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:42.969279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:42.969147    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:43.187285 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:43.187252    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:43.437189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:43.437058    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:43.863774 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:43.863653    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:43.864787 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:43.864765    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Nov 01 04:10:43.864889 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:43.864810    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Nov 01 04:10:44.286158 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:10:44.286119    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:10:44.864321 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:44.864287    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Nov 01 04:10:44.864785 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:44.864354    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Nov 01 04:10:45.864438 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:45.864404    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Nov 01 04:10:45.864971 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:45.864464    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Nov 01 04:10:46.864481 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:46.864447    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Nov 01 04:10:46.864848 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:46.864506    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Nov 01 04:10:47.864056 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:47.864012    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Nov 01 04:10:47.864320 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:47.864104    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Nov 01 04:10:48.846787 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:48.846756    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:48.869513 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:48.869481    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:48.869956 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:48.869937    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:48.870777 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:48.870756    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:10:49.043867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:49.043813    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" podStartSLOduration=8.043798695 podStartE2EDuration="8.043798695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:10:42.829325505 +0000 UTC m=+1663.589053301" watchObservedRunningTime="2026-11-01 04:10:49.043798695 +0000 UTC m=+1669.803526491"
Nov 01 04:10:50.004425 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:50.004383    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:50.208662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:50.208621    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:50.413914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:50.413885    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:51.248140 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:51.248099    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:51.884187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:51.881299    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:52.208700 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:52.208583    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:54.436146 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:54.436093    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:55.415838 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:55.415799    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"]
Nov 01 04:10:55.416026 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:55.416007    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy" containerID="cri-o://2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52" gracePeriod=30
Nov 01 04:10:55.863008 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:55.862917    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:56.067502 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.067472    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:56.517975 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.517940    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"]
Nov 01 04:10:56.523315 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.523290    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.581126 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.581089    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"]
Nov 01 04:10:56.601490 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601455    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.601670 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601513    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.601670 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601663    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.601769 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601751    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.601865 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601832    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.601946 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601932    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.601982 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601957    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.601982 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601976    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.602061 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.601998    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bnj\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-kube-api-access-27bnj\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.703785 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.703749    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.703984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.703803    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.703984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.703866    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.703984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.703892    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.703984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.703924    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.703984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.703948    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bnj\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-kube-api-access-27bnj\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.704294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.704014    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.704294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.704072    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.704294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.704181    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.704294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.704230    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-data\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.704527 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.704442    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-credential-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.704527 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.704512    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-certs\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.704614 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.704602    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-socket\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.704943 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.704919    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istiod-ca-cert\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.706259 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.706235    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-envoy\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.706571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.706553    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-podinfo\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.767839 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.767772    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:56.769551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.769456    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bnj\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-kube-api-access-27bnj\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.772023 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.771995    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-token\") pod \"e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") " pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.839666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.839633    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:56.975827 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:56.975750    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:10:57.311804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:57.311772    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"]
Nov 01 04:10:57.314069 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:10:57.314039    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc1683a_ff13_4259_8d0f_2f1f9a2a1f66.slice/crio-68fa2d441cb72ac221a01627b5c353bbb00580bb65cf130695297481519422ed WatchSource:0}: Error finding container 68fa2d441cb72ac221a01627b5c353bbb00580bb65cf130695297481519422ed: Status 404 returned error can't find the container with id 68fa2d441cb72ac221a01627b5c353bbb00580bb65cf130695297481519422ed
Nov 01 04:10:57.316610 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:57.316574    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:57.316703 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:57.316661    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:57.316835 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:57.316704    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:10:57.997660 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:57.997624    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" event={"ID":"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66","Type":"ContainerStarted","Data":"22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6"}
Nov 01 04:10:57.998610 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:57.998586    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" event={"ID":"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66","Type":"ContainerStarted","Data":"68fa2d441cb72ac221a01627b5c353bbb00580bb65cf130695297481519422ed"}
Nov 01 04:10:58.254248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:58.251939    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" podStartSLOduration=2.251917494 podStartE2EDuration="2.251917494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:10:58.173701277 +0000 UTC m=+1678.933429074" watchObservedRunningTime="2026-11-01 04:10:58.251917494 +0000 UTC m=+1679.011645288"
Nov 01 04:10:58.841192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:58.840544    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:10:58.843025 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:58.842988    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Nov 01 04:10:58.843210 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:58.843057    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Nov 01 04:10:59.842188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:59.840335    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Nov 01 04:10:59.842188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:59.840409    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Nov 01 04:10:59.929189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:10:59.926628    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:00.188600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.188565    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:00.390676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.390646    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:00.888902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.887564    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Nov 01 04:11:00.888902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.887614    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Nov 01 04:11:00.972343 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.972281    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:11:00.987660 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987632    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-kube-api-access-l8vmr\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-kube-api-access-l8vmr\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.987824 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987675    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-credential-socket\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.987824 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987752    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-envoy\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.987824 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987799    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-socket\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.987824 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987822    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-certs\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.988042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987848    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-token\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-token\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.988042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987891    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-podinfo\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.988042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987914    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-data\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.988042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987962    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad09f5d6-9f62-4d34-9873-cd5547105d89-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad09f5d6-9f62-4d34-9873-cd5547105d89-istiod-ca-cert\") pod \"ad09f5d6-9f62-4d34-9873-cd5547105d89\" (UID: \"ad09f5d6-9f62-4d34-9873-cd5547105d89\") "
Nov 01 04:11:00.988042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.987975    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-credential-socket" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:00.988341 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.988080    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-socket" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:00.988341 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.988130    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-data" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:00.988453 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.988412    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-certs" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:00.988514 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.988499    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:00.988570 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.988519    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:00.988570 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.988543    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:00.988570 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.988557    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:00.988570 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.988514    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad09f5d6-9f62-4d34-9873-cd5547105d89-istiod-ca-cert" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:11:00.990101 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.990075    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-kube-api-access-l8vmr" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "kube-api-access-l8vmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:00.990232 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.990099    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-token" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:00.990232 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.990149    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-envoy" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:00.990391 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:00.990366    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-podinfo" pod "ad09f5d6-9f62-4d34-9873-cd5547105d89" (UID: "ad09f5d6-9f62-4d34-9873-cd5547105d89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:11:01.069269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.069235    5529 generic.go:356] "Generic (PLEG): container finished" podID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerID="2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52" exitCode=0
Nov 01 04:11:01.069620 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.069603    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" event={"ID":"ad09f5d6-9f62-4d34-9873-cd5547105d89","Type":"ContainerDied","Data":"2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52"}
Nov 01 04:11:01.069781 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.069769    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" event={"ID":"ad09f5d6-9f62-4d34-9873-cd5547105d89","Type":"ContainerDied","Data":"41df0f95051ef0760e1bdcfa054210d90211ce79560c06c381f585af0e199453"}
Nov 01 04:11:01.069911 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.069884    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"
Nov 01 04:11:01.071642 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.069813    5529 scope.go:122] "RemoveContainer" containerID="2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52"
Nov 01 04:11:01.083321 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.083297    5529 scope.go:122] "RemoveContainer" containerID="2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52"
Nov 01 04:11:01.083628 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:11:01.083605    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52\": container with ID starting with 2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52 not found: ID does not exist" containerID="2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52"
Nov 01 04:11:01.083708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.083635    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52"} err="failed to get container status \"2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52\": rpc error: code = NotFound desc = could not find container \"2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52\": container with ID starting with 2c1c3f9c195fce455b42d7e1412b13bbb2f541b179c40c3e27c9686ea809bf52 not found: ID does not exist"
Nov 01 04:11:01.089562 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.089541    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:01.089562 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.089562    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:01.089680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.089572    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad09f5d6-9f62-4d34-9873-cd5547105d89-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:01.089680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.089582    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad09f5d6-9f62-4d34-9873-cd5547105d89-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:01.089680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.089591    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8vmr\" (UniqueName: \"kubernetes.io/projected/ad09f5d6-9f62-4d34-9873-cd5547105d89-kube-api-access-l8vmr\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:01.267998 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.267900    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"]
Nov 01 04:11:01.273778 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.273749    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68"]
Nov 01 04:11:01.375281 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.375253    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" path="/var/lib/kubelet/pods/ad09f5d6-9f62-4d34-9873-cd5547105d89/volumes"
Nov 01 04:11:01.843203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.842763    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Nov 01 04:11:01.843203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.842823    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Nov 01 04:11:01.957252 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.957216    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 04:11:01.957666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:01.957284    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-b5x68" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:11:02.844304 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:02.844268    5529 patch_prober.go:29] interesting pod/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Nov 01 04:11:02.844584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:02.844556    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Nov 01 04:11:03.960481 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:03.960449    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:11:03.961220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:03.961191    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:11:03.962337 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:03.962315    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:11:05.313060 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:05.313019    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:10.230377 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:10.230346    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:10.627346 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:10.627319    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:13.616556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:13.616517    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:13.817812 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:13.817783    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:14.285097 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:11:14.285053    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:11:15.164906 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:15.164861    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:19.477868 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:19.477839    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:20.680963 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:20.680932    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:21.051743 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:21.051649    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:21.283203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:21.283155    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:21.482443 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:21.482409    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:21.964042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:21.964007    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:22.053324 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:22.053288    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"]
Nov 01 04:11:22.053620 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:22.053586    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy" containerID="cri-o://a92319140a45b7b37d3ef95e7b7ca171e08ec3bcc8c7648d36c894d0c8984ae1" gracePeriod=30
Nov 01 04:11:22.621466 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:22.621428    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"]
Nov 01 04:11:22.621777 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:22.621685    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy" containerID="cri-o://cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599" gracePeriod=30
Nov 01 04:11:26.637793 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:26.637751    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:26.682341 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:26.682298    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 01 04:11:26.682576 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:26.682378    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 01 04:11:26.873438 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:26.873400    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"]
Nov 01 04:11:27.004269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.004147    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:27.286122 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.285910    5529 generic.go:356] "Generic (PLEG): container finished" podID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerID="a92319140a45b7b37d3ef95e7b7ca171e08ec3bcc8c7648d36c894d0c8984ae1" exitCode=0
Nov 01 04:11:27.286122 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.285980    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" event={"ID":"d6e73a83-0420-40e0-b911-4c6fba9bb393","Type":"ContainerDied","Data":"a92319140a45b7b37d3ef95e7b7ca171e08ec3bcc8c7648d36c894d0c8984ae1"}
Nov 01 04:11:27.331420 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.331394    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:11:27.387668 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387638    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-data\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.387668 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387671    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-socket\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.387910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387705    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-token\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-token\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.387910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387745    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-podinfo\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.387910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387807    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-credential-socket\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.387910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387841    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-envoy\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.387910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387874    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-certs\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.388219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387945    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-data" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.388219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387958    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-socket" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.388219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.387953    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6e73a83-0420-40e0-b911-4c6fba9bb393-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e73a83-0420-40e0-b911-4c6fba9bb393-istiod-ca-cert\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.388219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388041    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-kube-api-access-867fx\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-kube-api-access-867fx\") pod \"d6e73a83-0420-40e0-b911-4c6fba9bb393\" (UID: \"d6e73a83-0420-40e0-b911-4c6fba9bb393\") "
Nov 01 04:11:27.388219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388183    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-certs" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.388497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388204    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-credential-socket" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.388497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388336    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e73a83-0420-40e0-b911-4c6fba9bb393-istiod-ca-cert" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:11:27.388736 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388713    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.388736 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388739    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.388907 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388754    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.388907 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388767    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.388907 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.388779    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6e73a83-0420-40e0-b911-4c6fba9bb393-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.390067 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.390045    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-token" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:27.390219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.390064    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-podinfo" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:11:27.390488 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.390471    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-envoy" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.390561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.390542    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-kube-api-access-867fx" pod "d6e73a83-0420-40e0-b911-4c6fba9bb393" (UID: "d6e73a83-0420-40e0-b911-4c6fba9bb393"). InnerVolumeSpecName "kube-api-access-867fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:27.490899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.490863    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.490899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.490900    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.491193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.490915    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6e73a83-0420-40e0-b911-4c6fba9bb393-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.491193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.490931    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-867fx\" (UniqueName: \"kubernetes.io/projected/d6e73a83-0420-40e0-b911-4c6fba9bb393-kube-api-access-867fx\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.885223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.885128    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:11:27.998433 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998396    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-kube-api-access-ndc82\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-kube-api-access-ndc82\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998611 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998471    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-envoy\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998611 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998494    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16fb0a35-2a45-4325-98ca-d7091991776a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb0a35-2a45-4325-98ca-d7091991776a-istiod-ca-cert\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998611 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998516    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-istio-token\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-istio-token\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998611 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998556    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-credential-socket\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998805 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998680    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/16fb0a35-2a45-4325-98ca-d7091991776a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb0a35-2a45-4325-98ca-d7091991776a-istio-podinfo\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998805 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998723    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-data\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998920 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998812    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-certs\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998920 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998846    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-socket\") pod \"16fb0a35-2a45-4325-98ca-d7091991776a\" (UID: \"16fb0a35-2a45-4325-98ca-d7091991776a\") "
Nov 01 04:11:27.998920 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998856    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-credential-socket" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.999082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.998944    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16fb0a35-2a45-4325-98ca-d7091991776a-istiod-ca-cert" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:11:27.999082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.999055    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-data" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.999242 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.999205    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-certs" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.999325 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.999299    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-socket" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:27.999549 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.999527    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16fb0a35-2a45-4325-98ca-d7091991776a-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.999640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.999557    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.999640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.999572    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.999640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.999586    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:27.999640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:27.999599    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:28.000759 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.000738    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-kube-api-access-ndc82" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "kube-api-access-ndc82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:28.000914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.000896    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16fb0a35-2a45-4325-98ca-d7091991776a-istio-podinfo" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:11:28.001179 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.001150    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-istio-token" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:28.001276 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.001181    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-envoy" pod "16fb0a35-2a45-4325-98ca-d7091991776a" (UID: "16fb0a35-2a45-4325-98ca-d7091991776a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:28.101082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.101048    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndc82\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-kube-api-access-ndc82\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:28.101082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.101080    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16fb0a35-2a45-4325-98ca-d7091991776a-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:28.101280 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.101091    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16fb0a35-2a45-4325-98ca-d7091991776a-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:28.101280 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.101099    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16fb0a35-2a45-4325-98ca-d7091991776a-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:28.294697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.294614    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"
Nov 01 04:11:28.294697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.294649    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl" event={"ID":"d6e73a83-0420-40e0-b911-4c6fba9bb393","Type":"ContainerDied","Data":"56cfa40dce4e32e265007c08708a7771fab71cf0237391a184edc605021b4d02"}
Nov 01 04:11:28.294938 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.294714    5529 scope.go:122] "RemoveContainer" containerID="a92319140a45b7b37d3ef95e7b7ca171e08ec3bcc8c7648d36c894d0c8984ae1"
Nov 01 04:11:28.296391 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.296365    5529 generic.go:356] "Generic (PLEG): container finished" podID="16fb0a35-2a45-4325-98ca-d7091991776a" containerID="cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599" exitCode=0
Nov 01 04:11:28.296497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.296408    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"
Nov 01 04:11:28.296497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.296420    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" event={"ID":"16fb0a35-2a45-4325-98ca-d7091991776a","Type":"ContainerDied","Data":"cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599"}
Nov 01 04:11:28.296497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.296472    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk" event={"ID":"16fb0a35-2a45-4325-98ca-d7091991776a","Type":"ContainerDied","Data":"08b85f43096a3fd8728a18f2c93ca94190e3b3a54f088544954d9d642a8fa67e"}
Nov 01 04:11:28.306014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.305995    5529 scope.go:122] "RemoveContainer" containerID="cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599"
Nov 01 04:11:28.316827 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.316806    5529 scope.go:122] "RemoveContainer" containerID="cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599"
Nov 01 04:11:28.317113 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:11:28.317093    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599\": container with ID starting with cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599 not found: ID does not exist" containerID="cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599"
Nov 01 04:11:28.317204 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.317120    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599"} err="failed to get container status \"cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599\": rpc error: code = NotFound desc = could not find container \"cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599\": container with ID starting with cc87e58838d19597d858baf19807a845c0ba444b936096cf4f1214af82480599 not found: ID does not exist"
Nov 01 04:11:28.462305 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.462270    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"]
Nov 01 04:11:28.512196 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.512152    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-hgjwl"]
Nov 01 04:11:28.577292 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.577199    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"]
Nov 01 04:11:28.582186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:28.582144    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-162191-openshift-default-699bc96769-thrjk"]
Nov 01 04:11:29.378628 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:29.378588    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" path="/var/lib/kubelet/pods/16fb0a35-2a45-4325-98ca-d7091991776a/volumes"
Nov 01 04:11:29.379886 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:29.379859    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" path="/var/lib/kubelet/pods/d6e73a83-0420-40e0-b911-4c6fba9bb393/volumes"
Nov 01 04:11:30.853859 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:30.853822    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"]
Nov 01 04:11:30.854367 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:30.854039    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww" podUID="366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" containerName="maas-api" containerID="cri-o://b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66" gracePeriod=30
Nov 01 04:11:31.017564 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.015946    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:31.190664 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.190638    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:11:31.332419 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.331667    5529 generic.go:356] "Generic (PLEG): container finished" podID="366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" containerID="b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66" exitCode=0
Nov 01 04:11:31.332419 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.331821    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww" event={"ID":"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27","Type":"ContainerDied","Data":"b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66"}
Nov 01 04:11:31.332419 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.331870    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww" event={"ID":"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27","Type":"ContainerDied","Data":"76a0f94a6367f0d070693474f032d3e26b19a7f025c7fac359779e280bc6cfe1"}
Nov 01 04:11:31.332419 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.331891    5529 scope.go:122] "RemoveContainer" containerID="b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66"
Nov 01 04:11:31.332419 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.332036    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"
Nov 01 04:11:31.346205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.344823    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-openshift-service-ca\") pod \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") "
Nov 01 04:11:31.346205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.344883    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-metrics-certs\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-metrics-certs\") pod \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") "
Nov 01 04:11:31.346205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.344980    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-kube-api-access-bpszk\" (UniqueName: \"kubernetes.io/projected/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-kube-api-access-bpszk\") pod \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") "
Nov 01 04:11:31.346205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.345086    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls\") pod \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\" (UID: \"366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27\") "
Nov 01 04:11:31.346734 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.346601    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-openshift-service-ca" pod "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" (UID: "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:11:31.350699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.347307    5529 scope.go:122] "RemoveContainer" containerID="b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66"
Nov 01 04:11:31.350699 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:11:31.347704    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66\": container with ID starting with b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66 not found: ID does not exist" containerID="b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66"
Nov 01 04:11:31.350699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.347741    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66"} err="failed to get container status \"b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66\": rpc error: code = NotFound desc = could not find container \"b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66\": container with ID starting with b698ba438306c3e3460411e26b32afc435182c1dd8443ee8444639d7ee48cd66 not found: ID does not exist"
Nov 01 04:11:31.350699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.349558    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls" pod "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" (UID: "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:11:31.350699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.350339    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-kube-api-access-bpszk" pod "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" (UID: "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27"). InnerVolumeSpecName "kube-api-access-bpszk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:31.351028 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.350851    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-metrics-certs" pod "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" (UID: "366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:11:31.446914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.446828    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:31.446914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.446856    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:31.446914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.446866    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:31.446914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.446875    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpszk\" (UniqueName: \"kubernetes.io/projected/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27-kube-api-access-bpszk\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:31.748908 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.748816    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"]
Nov 01 04:11:31.754367 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:31.754340    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-78dad9-7cdf4c7d66-x4tww"]
Nov 01 04:11:32.666217 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:32.666180    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:32.895696 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:32.895661    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:33.097332 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:33.097255    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:33.374995 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:33.374964    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" path="/var/lib/kubelet/pods/366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27/volumes"
Nov 01 04:11:33.595590 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:33.595556    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:35.741594 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:35.741556    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:37.695521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:37.695472    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:39.412571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:39.412537    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:39.698115 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:39.698034    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:39.897715 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:39.897683    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:40.402009 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:40.401972    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:40.779895 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:40.779765    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:40.983257 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:40.983226    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:41.191013 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:41.190982    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:41.894992 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:41.894946    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8" podUID="e07ea663-1a34-4988-99f2-1420a5a89365" containerName="main" containerID="cri-o://b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01" gracePeriod=45
Nov 01 04:11:42.189300 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.189272    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:11:42.204555 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.204521    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e07ea663-1a34-4988-99f2-1420a5a89365-tls-certs\" (UniqueName: \"kubernetes.io/secret/e07ea663-1a34-4988-99f2-1420a5a89365-tls-certs\") pod \"e07ea663-1a34-4988-99f2-1420a5a89365\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") "
Nov 01 04:11:42.204721 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.204706    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-home\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-home\") pod \"e07ea663-1a34-4988-99f2-1420a5a89365\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") "
Nov 01 04:11:42.204794 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.204781    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-model-cache\") pod \"e07ea663-1a34-4988-99f2-1420a5a89365\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") "
Nov 01 04:11:42.204878 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.204861    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e07ea663-1a34-4988-99f2-1420a5a89365-kube-api-access-z4dd5\" (UniqueName: \"kubernetes.io/projected/e07ea663-1a34-4988-99f2-1420a5a89365-kube-api-access-z4dd5\") pod \"e07ea663-1a34-4988-99f2-1420a5a89365\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") "
Nov 01 04:11:42.204944 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.204908    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-tmp-dir\") pod \"e07ea663-1a34-4988-99f2-1420a5a89365\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") "
Nov 01 04:11:42.205006 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.204952    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-dshm\") pod \"e07ea663-1a34-4988-99f2-1420a5a89365\" (UID: \"e07ea663-1a34-4988-99f2-1420a5a89365\") "
Nov 01 04:11:42.205006 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.204965    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-home" pod "e07ea663-1a34-4988-99f2-1420a5a89365" (UID: "e07ea663-1a34-4988-99f2-1420a5a89365"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:42.205109 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.205070    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-model-cache" pod "e07ea663-1a34-4988-99f2-1420a5a89365" (UID: "e07ea663-1a34-4988-99f2-1420a5a89365"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:42.205317 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.205152    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-tmp-dir" pod "e07ea663-1a34-4988-99f2-1420a5a89365" (UID: "e07ea663-1a34-4988-99f2-1420a5a89365"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:42.205555 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.205529    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:42.205650 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.205561    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:42.205650 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.205576    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:42.206917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.206898    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e07ea663-1a34-4988-99f2-1420a5a89365-tls-certs" pod "e07ea663-1a34-4988-99f2-1420a5a89365" (UID: "e07ea663-1a34-4988-99f2-1420a5a89365"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:11:42.207083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.207062    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e07ea663-1a34-4988-99f2-1420a5a89365-kube-api-access-z4dd5" pod "e07ea663-1a34-4988-99f2-1420a5a89365" (UID: "e07ea663-1a34-4988-99f2-1420a5a89365"). InnerVolumeSpecName "kube-api-access-z4dd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:42.207189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.207079    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-dshm" pod "e07ea663-1a34-4988-99f2-1420a5a89365" (UID: "e07ea663-1a34-4988-99f2-1420a5a89365"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:42.306723 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.306693    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e07ea663-1a34-4988-99f2-1420a5a89365-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:42.306723 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.306721    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4dd5\" (UniqueName: \"kubernetes.io/projected/e07ea663-1a34-4988-99f2-1420a5a89365-kube-api-access-z4dd5\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:42.306723 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.306731    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e07ea663-1a34-4988-99f2-1420a5a89365-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:42.430845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.430754    5529 generic.go:356] "Generic (PLEG): container finished" podID="e07ea663-1a34-4988-99f2-1420a5a89365" containerID="b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01" exitCode=0
Nov 01 04:11:42.430845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.430820    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"
Nov 01 04:11:42.430845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.430831    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8" event={"ID":"e07ea663-1a34-4988-99f2-1420a5a89365","Type":"ContainerDied","Data":"b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01"}
Nov 01 04:11:42.431211 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.430892    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8" event={"ID":"e07ea663-1a34-4988-99f2-1420a5a89365","Type":"ContainerDied","Data":"71b1a9dd884a9405cb8fc32b837721683a956687f4d5f68012a0022c4c992b66"}
Nov 01 04:11:42.431211 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.430913    5529 scope.go:122] "RemoveContainer" containerID="b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01"
Nov 01 04:11:42.444003 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.443981    5529 scope.go:122] "RemoveContainer" containerID="b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01"
Nov 01 04:11:42.444363 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:11:42.444338    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01\": container with ID starting with b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01 not found: ID does not exist" containerID="b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01"
Nov 01 04:11:42.444432 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.444380    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01"} err="failed to get container status \"b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01\": rpc error: code = NotFound desc = could not find container \"b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01\": container with ID starting with b3a24cc0e9ffd7d202a6be6b7155fda66a0c7b4d7791f7e36a74ff63f512ec01 not found: ID does not exist"
Nov 01 04:11:42.598053 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.598015    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"]
Nov 01 04:11:42.604004 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:42.603968    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-078e0d65/e2e-lifecycle-model-078e0d65-kserve-69bdc897cc-lsfh8"]
Nov 01 04:11:43.373573 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:43.373539    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e07ea663-1a34-4988-99f2-1420a5a89365" path="/var/lib/kubelet/pods/e07ea663-1a34-4988-99f2-1420a5a89365/volumes"
Nov 01 04:11:44.285470 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:11:44.285382    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:11:45.095026 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:45.094943    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:45.342931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:45.342898    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:45.546013 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:45.545960    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:46.971279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:46.971247    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:47.190746 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:47.190659    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:47.255275 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:47.255242    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"]
Nov 01 04:11:47.255517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:47.255486    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy" containerID="cri-o://6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6" gracePeriod=30
Nov 01 04:11:47.398186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:47.394623    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:48.240732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:48.240697    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:48.812308 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:48.812259    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:49.037373 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:49.037337    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:50.415991 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:50.415959    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:52.533368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.533280    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:11:52.541840 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.541807    5529 generic.go:356] "Generic (PLEG): container finished" podID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerID="6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6" exitCode=0
Nov 01 04:11:52.542031 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.541843    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" event={"ID":"f87e9c6b-09fd-4b78-9fac-94afc5351c6b","Type":"ContainerDied","Data":"6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6"}
Nov 01 04:11:52.542031 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.541871    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"
Nov 01 04:11:52.542031 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.541901    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8" event={"ID":"f87e9c6b-09fd-4b78-9fac-94afc5351c6b","Type":"ContainerDied","Data":"30381af4059c5bd918c1ab4f03ab5ca53e41d975e976905cf84615608822a887"}
Nov 01 04:11:52.542031 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.541929    5529 scope.go:122] "RemoveContainer" containerID="6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6"
Nov 01 04:11:52.552421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.552391    5529 scope.go:122] "RemoveContainer" containerID="b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179"
Nov 01 04:11:52.562267 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.562247    5529 scope.go:122] "RemoveContainer" containerID="6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6"
Nov 01 04:11:52.562579 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:11:52.562557    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6\": container with ID starting with 6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6 not found: ID does not exist" containerID="6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6"
Nov 01 04:11:52.562623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.562588    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6"} err="failed to get container status \"6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6\": rpc error: code = NotFound desc = could not find container \"6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6\": container with ID starting with 6e666f90fa453c9e2d35ad2992301ff624635ad98db7f91f2753ecfedbdf34d6 not found: ID does not exist"
Nov 01 04:11:52.562623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.562605    5529 scope.go:122] "RemoveContainer" containerID="b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179"
Nov 01 04:11:52.562883 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:11:52.562862    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179\": container with ID starting with b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179 not found: ID does not exist" containerID="b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179"
Nov 01 04:11:52.562925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.562891    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179"} err="failed to get container status \"b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179\": rpc error: code = NotFound desc = could not find container \"b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179\": container with ID starting with b746738d7451fd9946c570f6b6f2865b6a435207526ea6bfc3344dd738327179 not found: ID does not exist"
Nov 01 04:11:52.653479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653441    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-socket\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.653676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653529    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-envoy\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.653676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653584    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-kube-api-access-v8qhd\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-kube-api-access-v8qhd\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.653676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653632    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istiod-ca-cert\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.653836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653687    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-certs\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.653836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653769    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-credential-socket\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.653836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653791    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-socket" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:52.653836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653821    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-token\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-token\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.654040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653873    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-podinfo\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.654040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.653925    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-data\") pod \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\" (UID: \"f87e9c6b-09fd-4b78-9fac-94afc5351c6b\") "
Nov 01 04:11:52.654138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.654061    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-credential-socket" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:52.654596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.654343    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-certs" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:52.654596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.654351    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-data" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:52.654596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.654496    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.654596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.654517    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.654596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.654531    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.654596 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.654543    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.654935 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.654802    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istiod-ca-cert" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:11:52.656435 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.656367    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-envoy" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:11:52.656545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.656470    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-kube-api-access-v8qhd" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "kube-api-access-v8qhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:52.656545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.656506    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-token" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:11:52.656951 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.656925    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-podinfo" pod "f87e9c6b-09fd-4b78-9fac-94afc5351c6b" (UID: "f87e9c6b-09fd-4b78-9fac-94afc5351c6b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:11:52.756600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.756523    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.756600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.756550    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.756600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.756561    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.756600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.756572    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8qhd\" (UniqueName: \"kubernetes.io/projected/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-kube-api-access-v8qhd\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.756600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.756587    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f87e9c6b-09fd-4b78-9fac-94afc5351c6b-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:11:52.968326 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.968289    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"]
Nov 01 04:11:52.972976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:52.972948    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6dd36b-openshift-default-5d78fccfbf-7gxl8"]
Nov 01 04:11:53.246697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:53.246642    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:53.373558 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:53.373521    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" path="/var/lib/kubelet/pods/f87e9c6b-09fd-4b78-9fac-94afc5351c6b/volumes"
Nov 01 04:11:54.583957 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:54.583876    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:55.857923 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:55.857874    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:56.977135 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:56.977101    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:57.178930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:57.178897    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:11:59.766991 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:11:59.766949    5529 scope.go:122] "RemoveContainer" containerID="c141b181a822f16b106f34362be2532f893962d1125bd6e36c31e50963e079ef"
Nov 01 04:12:01.257249 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:01.257215    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:03.206740 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:03.206696    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:04.474842 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:04.474809    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:06.415619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:06.415575    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:10.532668 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.532636    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:10.735082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.735047    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:10.828533 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.828445    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"]
Nov 01 04:12:10.828734 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.828706    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy" containerID="cri-o://0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef" gracePeriod=30
Nov 01 04:12:10.845747 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.845709    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"]
Nov 01 04:12:10.846016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.845971    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy" containerID="cri-o://90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec" gracePeriod=30
Nov 01 04:12:10.850844 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.850812    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"]
Nov 01 04:12:10.851083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.851058    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy" containerID="cri-o://22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6" gracePeriod=30
Nov 01 04:12:10.965714 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:10.965683    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:11.172248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:11.172206    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:11.402562 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:11.402528    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:11.600503 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:11.600415    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:12.859705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:12.859653    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:13.060984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:13.060949    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:14.285563 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:12:14.285528    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:12:16.150590 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.150458    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:12:16.188621 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.188594    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:12:16.196767 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.196741    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-credential-socket\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.196881 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.196784    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-kube-api-access-hn2rs\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-kube-api-access-hn2rs\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.196881 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.196830    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-socket\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.196881 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.196867    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59930b46-2332-4b45-a280-87198e5067e9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59930b46-2332-4b45-a280-87198e5067e9-istiod-ca-cert\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.196988 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.196904    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-istio-token\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-istio-token\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.196988 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.196956    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-certs\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.197049 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.196991    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-credential-socket" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.197049 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197032    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-data\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.197114 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197078    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/59930b46-2332-4b45-a280-87198e5067e9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59930b46-2332-4b45-a280-87198e5067e9-istio-podinfo\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.197147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197138    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-envoy\") pod \"59930b46-2332-4b45-a280-87198e5067e9\" (UID: \"59930b46-2332-4b45-a280-87198e5067e9\") "
Nov 01 04:12:16.197197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197134    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-socket" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.197309 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197283    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-certs" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.197434 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197348    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-data" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.197434 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197384    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59930b46-2332-4b45-a280-87198e5067e9-istiod-ca-cert" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:12:16.197658 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197634    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.197761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197664    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59930b46-2332-4b45-a280-87198e5067e9-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.197761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197681    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.197761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197696    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.197761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197709    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.197761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.197732    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:12:16.199211 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.199156    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-kube-api-access-hn2rs" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "kube-api-access-hn2rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:12:16.199211 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.199192    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59930b46-2332-4b45-a280-87198e5067e9-istio-podinfo" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:12:16.199608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.199589    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-envoy" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.199686 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.199612    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-istio-token" pod "59930b46-2332-4b45-a280-87198e5067e9" (UID: "59930b46-2332-4b45-a280-87198e5067e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:12:16.299016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.298980    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-kube-api-access-27bnj\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-kube-api-access-27bnj\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299028    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-token\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-token\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299060    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-credential-socket\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299141    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-podinfo\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299159    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istiod-ca-cert\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299238    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-data\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299262    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-envoy\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299289    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-envoy\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299322    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-podinfo\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299354    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-credential-socket\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299385    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-certs\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299442    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e325476-56be-4cf2-aaf2-6d04f04c4245-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e325476-56be-4cf2-aaf2-6d04f04c4245-istiod-ca-cert\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299471    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-kube-api-access-l99fb\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-kube-api-access-l99fb\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299485    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-credential-socket" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.299521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299497    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-socket\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299589    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-certs\") pod \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\" (UID: \"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66\") "
Nov 01 04:12:16.299961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299667    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-socket" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.299961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299722    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-token\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-token\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299788    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-socket\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299850    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-data\") pod \"8e325476-56be-4cf2-aaf2-6d04f04c4245\" (UID: \"8e325476-56be-4cf2-aaf2-6d04f04c4245\") "
Nov 01 04:12:16.299961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.299892    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-credential-socket" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.300311 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300063    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-certs" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.300378 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300332    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e325476-56be-4cf2-aaf2-6d04f04c4245-istiod-ca-cert" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:12:16.300468 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300448    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300525 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300475    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300525 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300491    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300525 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300505    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59930b46-2332-4b45-a280-87198e5067e9-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300525 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300518    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e325476-56be-4cf2-aaf2-6d04f04c4245-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300532    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300554    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-socket" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.300729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300562    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59930b46-2332-4b45-a280-87198e5067e9-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300579    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn2rs\" (UniqueName: \"kubernetes.io/projected/59930b46-2332-4b45-a280-87198e5067e9-kube-api-access-hn2rs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300594    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.300729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300723    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-certs" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.301029 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300755    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-data" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.301029 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.300922    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-data" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.301139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.301062    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istiod-ca-cert" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:12:16.301914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.301883    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-token" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:12:16.303743 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.303713    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-kube-api-access-27bnj" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "kube-api-access-27bnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:12:16.303849 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.303779    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-podinfo" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:12:16.303849 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.303797    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-kube-api-access-l99fb" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "kube-api-access-l99fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:12:16.303932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.303913    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-envoy" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.304015 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.304002    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-envoy" pod "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" (UID: "4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:12:16.304615 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.304596    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-token" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:12:16.304701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.304674    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-podinfo" pod "8e325476-56be-4cf2-aaf2-6d04f04c4245" (UID: "8e325476-56be-4cf2-aaf2-6d04f04c4245"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:12:16.401559 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401513    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401559 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401550    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401559 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401565    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401580    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27bnj\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-kube-api-access-27bnj\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401597    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401610    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401623    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401638    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401651    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401666    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401680    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e325476-56be-4cf2-aaf2-6d04f04c4245-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401694    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l99fb\" (UniqueName: \"kubernetes.io/projected/8e325476-56be-4cf2-aaf2-6d04f04c4245-kube-api-access-l99fb\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.401877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.401710    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:12:16.614208 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.613680    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:16.724678 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.724576    5529 generic.go:356] "Generic (PLEG): container finished" podID="59930b46-2332-4b45-a280-87198e5067e9" containerID="90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec" exitCode=0
Nov 01 04:12:16.724678 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.724623    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"
Nov 01 04:12:16.724914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.724623    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" event={"ID":"59930b46-2332-4b45-a280-87198e5067e9","Type":"ContainerDied","Data":"90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec"}
Nov 01 04:12:16.724914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.724758    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5" event={"ID":"59930b46-2332-4b45-a280-87198e5067e9","Type":"ContainerDied","Data":"fc9c591b4918464e385316d4d076e16897af1987a14c0cfad26a8eca957a77c5"}
Nov 01 04:12:16.724914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.724792    5529 scope.go:122] "RemoveContainer" containerID="90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec"
Nov 01 04:12:16.732502 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.732350    5529 generic.go:356] "Generic (PLEG): container finished" podID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerID="0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef" exitCode=0
Nov 01 04:12:16.732628 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.732572    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" event={"ID":"8e325476-56be-4cf2-aaf2-6d04f04c4245","Type":"ContainerDied","Data":"0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef"}
Nov 01 04:12:16.732628 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.732600    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"
Nov 01 04:12:16.732628 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.732618    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9" event={"ID":"8e325476-56be-4cf2-aaf2-6d04f04c4245","Type":"ContainerDied","Data":"1b23854181e8ae621ec22c139ed77270f2b75c587a9d175a5db50ca9eb6191b5"}
Nov 01 04:12:16.734444 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.734416    5529 generic.go:356] "Generic (PLEG): container finished" podID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerID="22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6" exitCode=0
Nov 01 04:12:16.734551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.734465    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" event={"ID":"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66","Type":"ContainerDied","Data":"22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6"}
Nov 01 04:12:16.734551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.734495    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8" event={"ID":"4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66","Type":"ContainerDied","Data":"68fa2d441cb72ac221a01627b5c353bbb00580bb65cf130695297481519422ed"}
Nov 01 04:12:16.734551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.734549    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"
Nov 01 04:12:16.741842 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.741819    5529 scope.go:122] "RemoveContainer" containerID="90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec"
Nov 01 04:12:16.742136 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:12:16.742108    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec\": container with ID starting with 90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec not found: ID does not exist" containerID="90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec"
Nov 01 04:12:16.742226 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.742136    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec"} err="failed to get container status \"90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec\": rpc error: code = NotFound desc = could not find container \"90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec\": container with ID starting with 90993b19bfff437dc40631707bc23633387bff0184d0f94b603e739be822f7ec not found: ID does not exist"
Nov 01 04:12:16.742226 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.742157    5529 scope.go:122] "RemoveContainer" containerID="0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef"
Nov 01 04:12:16.755464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.755442    5529 scope.go:122] "RemoveContainer" containerID="0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef"
Nov 01 04:12:16.755826 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:12:16.755805    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef\": container with ID starting with 0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef not found: ID does not exist" containerID="0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef"
Nov 01 04:12:16.755905 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.755837    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef"} err="failed to get container status \"0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef\": rpc error: code = NotFound desc = could not find container \"0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef\": container with ID starting with 0250e215b4d5de020491aaa9fd6e38ee13ddd6236e92f4d315b310cb870d23ef not found: ID does not exist"
Nov 01 04:12:16.755905 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.755863    5529 scope.go:122] "RemoveContainer" containerID="22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6"
Nov 01 04:12:16.765774 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.765751    5529 scope.go:122] "RemoveContainer" containerID="22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6"
Nov 01 04:12:16.766071 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:12:16.766046    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6\": container with ID starting with 22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6 not found: ID does not exist" containerID="22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6"
Nov 01 04:12:16.766188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.766076    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6"} err="failed to get container status \"22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6\": rpc error: code = NotFound desc = could not find container \"22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6\": container with ID starting with 22e8a3e8e474fb83f54ff6893df50f06518aa568e97f630197bb6d010f9d3ba6 not found: ID does not exist"
Nov 01 04:12:16.892478 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.892443    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"]
Nov 01 04:12:16.898206 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:16.898178    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-mw2q5"]
Nov 01 04:12:17.009900 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:17.009808    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"]
Nov 01 04:12:17.016902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:17.016868    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-2s4w9"]
Nov 01 04:12:17.128349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:17.128315    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"]
Nov 01 04:12:17.132936 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:17.132902    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-078e0d65-openshift-default-66569d64b9-bv6p8"]
Nov 01 04:12:17.374428 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:17.374404    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" path="/var/lib/kubelet/pods/4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66/volumes"
Nov 01 04:12:17.374912 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:17.374898    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59930b46-2332-4b45-a280-87198e5067e9" path="/var/lib/kubelet/pods/59930b46-2332-4b45-a280-87198e5067e9/volumes"
Nov 01 04:12:17.375332 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:17.375318    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" path="/var/lib/kubelet/pods/8e325476-56be-4cf2-aaf2-6d04f04c4245/volumes"
Nov 01 04:12:21.034492 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:21.034460    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:21.645393 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:21.645357    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:26.643692 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:26.643654    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:30.680093 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:30.680054    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:31.620263 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:31.620229    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:36.591573 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:36.591539    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:36.785620 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:36.785581    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:38.117128 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:38.117097    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:38.495372 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:38.495337    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:38.691949 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:38.691910    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:42.034499 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:42.034466    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:42.232880 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:42.232853    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:42.430376 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:42.430341    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:44.285761 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:12:44.285729    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:12:47.223697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:47.223604    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:52.309657 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:52.309620    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:57.261128 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:57.261089    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:12:59.649739 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:59.649698    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:12:59.657930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:12:59.657908    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:13:02.207679 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:02.207645    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:07.206950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:07.206916    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:11.367060 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:11.366981    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:12.195457 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:12.195418    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:14.284658 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:13:14.284618    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:13:17.144769 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:17.144728    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:21.528189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:21.524149    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:21.743934 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:21.743900    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:23.312796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:23.312762    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:23.611002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:23.610923    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:23.829809 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:23.829748    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:24.371560 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:24.371527    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:27.833829 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:27.833793    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:28.343384 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:28.343347    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:30.459855 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:30.459822    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:30.681384 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:30.681347    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:30.883218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:30.883181    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:31.078313 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:31.078277    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:33.559964 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:33.559923    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:34.255472 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:34.255440    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:34.551653 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:34.551575    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:36.014045 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:36.013995    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:38.379803 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:38.379764    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:38.580682 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:38.580651    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:41.322447 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:41.322409    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:41.494362 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:41.494332    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"]
Nov 01 04:13:41.494573 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:41.494547    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy" containerID="cri-o://160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79" gracePeriod=30
Nov 01 04:13:41.570477 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:41.570438    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:41.776306 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:41.776268    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:42.089688 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.089604    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"]
Nov 01 04:13:42.090542 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090515    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy"
Nov 01 04:13:42.090743 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090718    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy"
Nov 01 04:13:42.090845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090753    5529 cpu_manager.go:414] "containerMap: removing container" podUID="e07ea663-1a34-4988-99f2-1420a5a89365" containerName="main"
Nov 01 04:13:42.090845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090762    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e07ea663-1a34-4988-99f2-1420a5a89365" containerName="main"
Nov 01 04:13:42.090845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090782    5529 cpu_manager.go:414] "containerMap: removing container" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy"
Nov 01 04:13:42.090845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090789    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy"
Nov 01 04:13:42.090845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090804    5529 cpu_manager.go:414] "containerMap: removing container" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy"
Nov 01 04:13:42.090845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090813    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy"
Nov 01 04:13:42.090845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090824    5529 cpu_manager.go:414] "containerMap: removing container" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy"
Nov 01 04:13:42.090845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090831    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090860    5529 cpu_manager.go:414] "containerMap: removing container" podUID="366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" containerName="maas-api"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090868    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" containerName="maas-api"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090893    5529 cpu_manager.go:414] "containerMap: removing container" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090900    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090935    5529 cpu_manager.go:414] "containerMap: removing container" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090942    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090955    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090962    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090979    5529 cpu_manager.go:414] "containerMap: removing container" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy"
Nov 01 04:13:42.091084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.090986    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091120    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e325476-56be-4cf2-aaf2-6d04f04c4245" containerName="istio-proxy"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091135    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091146    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad09f5d6-9f62-4d34-9873-cd5547105d89" containerName="istio-proxy"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091159    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="e07ea663-1a34-4988-99f2-1420a5a89365" containerName="main"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091187    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="16fb0a35-2a45-4325-98ca-d7091991776a" containerName="istio-proxy"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091194    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="59930b46-2332-4b45-a280-87198e5067e9" containerName="istio-proxy"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091203    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6e73a83-0420-40e0-b911-4c6fba9bb393" containerName="istio-proxy"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091215    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="366bf4d7-0b8f-4f48-9441-6c0fbbbb3c27" containerName="maas-api"
Nov 01 04:13:42.091396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.091226    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="4bc1683a-ff13-4259-8d0f-2f1f9a2a1f66" containerName="istio-proxy"
Nov 01 04:13:42.095308 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.095278    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:42.146274 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.146235    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"]
Nov 01 04:13:42.148648 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.148604    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-131718\""
Nov 01 04:13:42.148831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.148772    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-131718-dockercfg-27rk7\""
Nov 01 04:13:42.205016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.204980    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-131718-99f467587-47lnx\" (UID: \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:42.205245 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.205222    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4qdh\" (UniqueName: \"kubernetes.io/projected/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-kube-api-access-h4qdh\") pod \"payload-processing-e2e-ipp-a-131718-99f467587-47lnx\" (UID: \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:42.306178 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.306135    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4qdh\" (UniqueName: \"kubernetes.io/projected/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-kube-api-access-h4qdh\") pod \"payload-processing-e2e-ipp-a-131718-99f467587-47lnx\" (UID: \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:42.306358 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.306241    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-131718-99f467587-47lnx\" (UID: \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:42.306962 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.306941    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-131718-99f467587-47lnx\" (UID: \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:42.368371 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.368293    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4qdh\" (UniqueName: \"kubernetes.io/projected/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-kube-api-access-h4qdh\") pod \"payload-processing-e2e-ipp-a-131718-99f467587-47lnx\" (UID: \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:42.409868 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.409834    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:42.788698 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:42.788668    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"]
Nov 01 04:13:42.790987 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:13:42.790957    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b8b900_6c7c_444e_9150_f4ed8ab39e67.slice/crio-953d6baa1c1f926cb4d1fc0769b632686ef3510aab4b3aab1d0b489489765c28 WatchSource:0}: Error finding container 953d6baa1c1f926cb4d1fc0769b632686ef3510aab4b3aab1d0b489489765c28: Status 404 returned error can't find the container with id 953d6baa1c1f926cb4d1fc0769b632686ef3510aab4b3aab1d0b489489765c28
Nov 01 04:13:43.450256 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:43.450209    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx" event={"ID":"e2b8b900-6c7c-444e-9150-f4ed8ab39e67","Type":"ContainerStarted","Data":"75b57f69f3628983c46cf2058303137e3f64b2daddf5449554b3ab8e54628b35"}
Nov 01 04:13:43.450662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:43.450274    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx" event={"ID":"e2b8b900-6c7c-444e-9150-f4ed8ab39e67","Type":"ContainerStarted","Data":"953d6baa1c1f926cb4d1fc0769b632686ef3510aab4b3aab1d0b489489765c28"}
Nov 01 04:13:43.450662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:43.450303    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:43.567576 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:43.567524    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx" podStartSLOduration=1.567509794 podStartE2EDuration="1.567509794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:13:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:13:43.56615265 +0000 UTC m=+1844.325880446" watchObservedRunningTime="2026-11-01 04:13:43.567509794 +0000 UTC m=+1844.327237622"
Nov 01 04:13:44.289517 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:13:44.289475    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:13:45.770916 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:45.770850    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:46.332472 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.332428    5529 patch_prober.go:29] interesting pod/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 01 04:13:46.332675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.332505    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 01 04:13:46.620284 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.620245    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:46.780140 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.780114    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:13:46.825525 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.825495    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:46.855143 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855102    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-kube-api-access-lcpgb\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-kube-api-access-lcpgb\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.855369 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855207    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-envoy\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.855369 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855254    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-socket\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.855478 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855383    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dae9f650-0909-457b-8bdc-a4756fdfef2a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae9f650-0909-457b-8bdc-a4756fdfef2a-istiod-ca-cert\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.855478 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855434    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-certs\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.855582 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855484    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-token\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-token\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855748    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-podinfo\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855789    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-certs" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855802    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-credential-socket\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.855952    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-data\") pod \"dae9f650-0909-457b-8bdc-a4756fdfef2a\" (UID: \"dae9f650-0909-457b-8bdc-a4756fdfef2a\") "
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.856428    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dae9f650-0909-457b-8bdc-a4756fdfef2a-istiod-ca-cert" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.856564    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dae9f650-0909-457b-8bdc-a4756fdfef2a-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.856774    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.856651    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-data" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:46.856823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.856737    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-credential-socket" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:46.857807 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.857777    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-socket" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:46.857887 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.857864    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-token" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:13:46.859268 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.859231    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-envoy" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:46.859268 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.859242    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-kube-api-access-lcpgb" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "kube-api-access-lcpgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:13:46.859826 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.859797    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-podinfo" pod "dae9f650-0909-457b-8bdc-a4756fdfef2a" (UID: "dae9f650-0909-457b-8bdc-a4756fdfef2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:13:46.959037 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.958993    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcpgb\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-kube-api-access-lcpgb\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:46.959037 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.959039    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:46.959343 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.959054    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:46.959343 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.959068    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:46.959343 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.959082    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:46.959343 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.959095    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:46.959343 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:46.959108    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dae9f650-0909-457b-8bdc-a4756fdfef2a-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:47.080611 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.080575    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"]
Nov 01 04:13:47.081261 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.081244    5529 cpu_manager.go:414] "containerMap: removing container" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy"
Nov 01 04:13:47.081326 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.081262    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy"
Nov 01 04:13:47.081363 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.081358    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="f87e9c6b-09fd-4b78-9fac-94afc5351c6b" containerName="istio-proxy"
Nov 01 04:13:47.081396 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.081369    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerName="istio-proxy"
Nov 01 04:13:47.085088 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.085069    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.141451 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.140383    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-535e84-openshift-default-dockercfg-8g6kg\""
Nov 01 04:13:47.146346 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.146308    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"]
Nov 01 04:13:47.161154 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161105    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd637ff4-9c68-40f4-9efa-654bedbf4206-istiod-ca-cert\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.161357 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161179    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-certs\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.161357 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161210    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-podinfo\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.161357 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161233    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-socket\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.161357 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161248    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-credential-socket\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.161357 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161263    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-token\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.161357 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161290    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-675kv\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-kube-api-access-675kv\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.161357 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161348    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-envoy\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.161750 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.161399    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-data\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.230229 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.229053    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.265886    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-podinfo\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.265950    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-socket\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.265979    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-credential-socket\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.266008    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-token\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.266051    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-675kv\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-kube-api-access-675kv\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.266135    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-envoy\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.266227    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-data\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.266340    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd637ff4-9c68-40f4-9efa-654bedbf4206-istiod-ca-cert\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.266391    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-certs\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.267831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.266875    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-certs\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.275188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.270624    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-podinfo\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.275188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.270922    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-socket\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.275188 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.271523    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-credential-socket\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.284223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.276791    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd637ff4-9c68-40f4-9efa-654bedbf4206-istiod-ca-cert\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.284223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.278379    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-envoy\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.284223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.278510    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-data\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.350185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.343719    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-token\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.350949 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.350916    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-675kv\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-kube-api-access-675kv\") pod \"e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") " pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.402763 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.402455    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:47.443845 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.443761    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:47.481783 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.481744    5529 generic.go:356] "Generic (PLEG): container finished" podID="dae9f650-0909-457b-8bdc-a4756fdfef2a" containerID="160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79" exitCode=0
Nov 01 04:13:47.481975 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.481814    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" event={"ID":"dae9f650-0909-457b-8bdc-a4756fdfef2a","Type":"ContainerDied","Data":"160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79"}
Nov 01 04:13:47.481975 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.481867    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4" event={"ID":"dae9f650-0909-457b-8bdc-a4756fdfef2a","Type":"ContainerDied","Data":"66092605e0e99bd6639b1f3eb994318702e07379530aa67a81942665c82851ba"}
Nov 01 04:13:47.481975 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.481897    5529 scope.go:122] "RemoveContainer" containerID="160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79"
Nov 01 04:13:47.482121 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.482045    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"
Nov 01 04:13:47.496276 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.496245    5529 scope.go:122] "RemoveContainer" containerID="160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79"
Nov 01 04:13:47.496731 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:13:47.496707    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79\": container with ID starting with 160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79 not found: ID does not exist" containerID="160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79"
Nov 01 04:13:47.496826 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.496742    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79"} err="failed to get container status \"160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79\": rpc error: code = NotFound desc = could not find container \"160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79\": container with ID starting with 160790b3044dbfb5b15ba526c2a6266eb90092dda5f01dc21d1ed99d22175b79 not found: ID does not exist"
Nov 01 04:13:47.642319 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.642262    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:47.666247 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.666122    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"]
Nov 01 04:13:47.670686 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.670654    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-865066-openshift-default-6559876c99-z8mm4"]
Nov 01 04:13:47.833941 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.833912    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"]
Nov 01 04:13:47.836575 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:13:47.836549    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd637ff4_9c68_40f4_9efa_654bedbf4206.slice/crio-423cd6fd32d7c369bbe21355def700eb7c5426fffec23ee453cfb1f2756433c4 WatchSource:0}: Error finding container 423cd6fd32d7c369bbe21355def700eb7c5426fffec23ee453cfb1f2756433c4: Status 404 returned error can't find the container with id 423cd6fd32d7c369bbe21355def700eb7c5426fffec23ee453cfb1f2756433c4
Nov 01 04:13:47.839699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.839659    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:13:47.839821 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.839744    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:13:47.839821 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:47.839789    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:13:48.489932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:48.489898    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" event={"ID":"bd637ff4-9c68-40f4-9efa-654bedbf4206","Type":"ContainerStarted","Data":"7492f082d5476ae0220930e064be814bcf5c679eb5ced896e2ef991f628e7d90"}
Nov 01 04:13:48.490146 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:48.489952    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" event={"ID":"bd637ff4-9c68-40f4-9efa-654bedbf4206","Type":"ContainerStarted","Data":"423cd6fd32d7c369bbe21355def700eb7c5426fffec23ee453cfb1f2756433c4"}
Nov 01 04:13:48.613701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:48.613632    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" podStartSLOduration=1.6136158809999999 podStartE2EDuration="1.613615881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:13:48.611339813 +0000 UTC m=+1849.371067605" watchObservedRunningTime="2026-11-01 04:13:48.613615881 +0000 UTC m=+1849.373343743"
Nov 01 04:13:49.382466 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:49.382422    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dae9f650-0909-457b-8bdc-a4756fdfef2a" path="/var/lib/kubelet/pods/dae9f650-0909-457b-8bdc-a4756fdfef2a/volumes"
Nov 01 04:13:49.403951 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:49.403918    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:49.409750 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:49.409728    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:49.497991 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:49.497960    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:49.499037 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:49.499018    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:13:51.190908 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.190877    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:51.658670 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.658632    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"]
Nov 01 04:13:51.662918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.662894    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.720823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.720792    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-2d683e-openshift-default-dockercfg-j7s52\""
Nov 01 04:13:51.740875 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.740821    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-socket\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.741082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.740893    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7fcb708-5355-4d46-9c90-f7c596e8542a-istiod-ca-cert\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.741082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.741015    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgvb7\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-kube-api-access-jgvb7\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.741218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.741083    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-podinfo\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.741272 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.741246    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-certs\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.741332 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.741280    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-envoy\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.741412 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.741395    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-token\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.741466 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.741443    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-credential-socket\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.741584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.741561    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-data\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.769481 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.769441    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"]
Nov 01 04:13:51.785349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.782846    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:51.851189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.850853    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-token\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.851189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.850919    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-credential-socket\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.851189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.851002    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-data\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.851189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.851030    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-socket\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.851189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.851071    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7fcb708-5355-4d46-9c90-f7c596e8542a-istiod-ca-cert\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.851189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.851104    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgvb7\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-kube-api-access-jgvb7\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.851189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.851133    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-podinfo\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.851709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.851232    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-certs\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.851709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.851256    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-envoy\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.859220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.852763    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7fcb708-5355-4d46-9c90-f7c596e8542a-istiod-ca-cert\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.859220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.857358    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-credential-socket\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.859220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.858254    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-envoy\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.859220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.858720    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-socket\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.859220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.858834    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-certs\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.859220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.858937    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-data\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.881834 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.881794    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-podinfo\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.914020 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.913935    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgvb7\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-kube-api-access-jgvb7\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.921183 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.918619    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-token\") pod \"e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") " pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.977624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.977326    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:51.982277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:51.982246    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:52.183081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.182996    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:52.425659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.425623    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"]
Nov 01 04:13:52.433457 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:13:52.433388    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7fcb708_5355_4d46_9c90_f7c596e8542a.slice/crio-598f71fff363957417cd7cb763ba78b178618946c7fe8b66f1778f0936103c79 WatchSource:0}: Error finding container 598f71fff363957417cd7cb763ba78b178618946c7fe8b66f1778f0936103c79: Status 404 returned error can't find the container with id 598f71fff363957417cd7cb763ba78b178618946c7fe8b66f1778f0936103c79
Nov 01 04:13:52.435809 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.435769    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:13:52.435906 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.435840    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:13:52.435906 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.435874    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:13:52.474158 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.474121    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:52.521631 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.521089    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" event={"ID":"c7fcb708-5355-4d46-9c90-f7c596e8542a","Type":"ContainerStarted","Data":"4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df"}
Nov 01 04:13:52.521631 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.521153    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" event={"ID":"c7fcb708-5355-4d46-9c90-f7c596e8542a","Type":"ContainerStarted","Data":"598f71fff363957417cd7cb763ba78b178618946c7fe8b66f1778f0936103c79"}
Nov 01 04:13:52.661179 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.661103    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podStartSLOduration=1.6610846289999999 podStartE2EDuration="1.661084629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:13:52.658094676 +0000 UTC m=+1853.417822497" watchObservedRunningTime="2026-11-01 04:13:52.661084629 +0000 UTC m=+1853.420812424"
Nov 01 04:13:52.738082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.737986    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:52.978897 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:52.978864    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:53.983761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:53.983731    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:54.460902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:54.460870    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:13:54.534464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:54.534420    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:54.535303 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:54.535284    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:13:54.626586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:54.626547    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"]
Nov 01 04:13:54.626837 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:54.626803    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" containerID="cri-o://16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68" gracePeriod=30
Nov 01 04:13:55.685342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:55.685303    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:55.880775 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:55.880737    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:56.114823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:56.114736    5529 patch_prober.go:29] interesting pod/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 01 04:13:56.114978 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:56.114812    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 01 04:13:56.532527 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:56.532478    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:56.732113 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:56.732079    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:56.931057 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:56.931017    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:57.409905 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:57.409840    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:13:59.902360 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.902297    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 04:13:59.983449 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983410    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c4b0a70-b431-4cb0-9748-93def341c4ca-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c4b0a70-b431-4cb0-9748-93def341c4ca-istiod-ca-cert\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.983649 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983482    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-credential-socket\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.983649 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983579    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-kube-api-access-vhd7k\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-kube-api-access-vhd7k\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.983649 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983626    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-envoy\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.983831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983717    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-data\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.983831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983751    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-podinfo\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.983831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983786    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-credential-socket" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:59.983831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983797    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-socket\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.984081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983866    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c4b0a70-b431-4cb0-9748-93def341c4ca-istiod-ca-cert" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:13:59.984081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983884    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-token\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-token\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.984081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983962    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-data" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:59.984081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.983995    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-certs\") pod \"8c4b0a70-b431-4cb0-9748-93def341c4ca\" (UID: \"8c4b0a70-b431-4cb0-9748-93def341c4ca\") "
Nov 01 04:13:59.984081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.984018    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-socket" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:59.984395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.984251    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-certs" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:59.984467 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.984447    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c4b0a70-b431-4cb0-9748-93def341c4ca-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:59.984517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.984472    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:59.984517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.984484    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:59.984517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.984493    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:59.984517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.984502    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:13:59.986075 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.986046    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-token" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:13:59.986075 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.986070    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-envoy" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:13:59.986364 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.986341    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-podinfo" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:13:59.986471 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:13:59.986344    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-kube-api-access-vhd7k" pod "8c4b0a70-b431-4cb0-9748-93def341c4ca" (UID: "8c4b0a70-b431-4cb0-9748-93def341c4ca"). InnerVolumeSpecName "kube-api-access-vhd7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:14:00.086047 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.086013    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:14:00.086047 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.086043    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhd7k\" (UniqueName: \"kubernetes.io/projected/8c4b0a70-b431-4cb0-9748-93def341c4ca-kube-api-access-vhd7k\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:14:00.086047 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.086053    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:14:00.086416 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.086061    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c4b0a70-b431-4cb0-9748-93def341c4ca-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:14:00.345259 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.344922    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:00.574710 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.574680    5529 generic.go:356] "Generic (PLEG): container finished" podID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerID="16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68" exitCode=0
Nov 01 04:14:00.574899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.574747    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"
Nov 01 04:14:00.574899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.574763    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" event={"ID":"8c4b0a70-b431-4cb0-9748-93def341c4ca","Type":"ContainerDied","Data":"16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68"}
Nov 01 04:14:00.574899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.574818    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt" event={"ID":"8c4b0a70-b431-4cb0-9748-93def341c4ca","Type":"ContainerDied","Data":"22588742688d33b789aedf768f0ce41f5c47757e2befe9666aa3bcaa22d3aa8b"}
Nov 01 04:14:00.574899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.574840    5529 scope.go:122] "RemoveContainer" containerID="16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68"
Nov 01 04:14:00.585351 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.585323    5529 scope.go:122] "RemoveContainer" containerID="16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68"
Nov 01 04:14:00.585697 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:14:00.585672    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68\": container with ID starting with 16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68 not found: ID does not exist" containerID="16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68"
Nov 01 04:14:00.585913 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.585709    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68"} err="failed to get container status \"16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68\": rpc error: code = NotFound desc = could not find container \"16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68\": container with ID starting with 16a137d407fa1c39c71e738f2901200dd238e76cc31ab978628e00efde984d68 not found: ID does not exist"
Nov 01 04:14:00.655654 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.655622    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:00.765383 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.765352    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"]
Nov 01 04:14:00.876181 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:00.875732    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-8q7lt"]
Nov 01 04:14:01.375308 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:01.375272    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" path="/var/lib/kubelet/pods/8c4b0a70-b431-4cb0-9748-93def341c4ca/volumes"
Nov 01 04:14:02.996373 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:02.996333    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:08.075210 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:08.075116    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:11.645160 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:11.645118    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:12.061886 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:12.061772    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:13.009240 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:13.009201    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:14.285265 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:14:14.285223    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:14:18.045316 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:18.045279    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:18.251663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:18.251624    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:20.603811 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:20.603760    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:20.802699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:20.802660    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:21.736141 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:21.736111    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:22.065722 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:22.065637    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:22.263070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:22.263038    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:24.915751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:24.915719    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:28.469735 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:28.469696    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:28.665790 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:28.665758    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:30.127975 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:30.127931    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:33.844685 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:33.844641    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:34.353399 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:34.353365    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:36.713829 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.713793    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"]
Nov 01 04:14:36.714560 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.714539    5529 cpu_manager.go:414] "containerMap: removing container" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy"
Nov 01 04:14:36.714661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.714561    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy"
Nov 01 04:14:36.714743 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.714730    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c4b0a70-b431-4cb0-9748-93def341c4ca" containerName="istio-proxy"
Nov 01 04:14:36.718325 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.718306    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.772929 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.772889    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"]
Nov 01 04:14:36.778802 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.778769    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-metrics-certs\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.778952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.778830    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxqh\" (UniqueName: \"kubernetes.io/projected/96138547-d4dd-450b-8b63-92753452d3bb-kube-api-access-4mxqh\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.779024 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.778950    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96138547-d4dd-450b-8b63-92753452d3bb-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.779081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.779060    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.819685 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.819652    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-131718-serving-cert\""
Nov 01 04:14:36.879795 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.879761    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96138547-d4dd-450b-8b63-92753452d3bb-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.879972 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.879822    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.879972 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.879907    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-metrics-certs\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.879972 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.879932    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxqh\" (UniqueName: \"kubernetes.io/projected/96138547-d4dd-450b-8b63-92753452d3bb-kube-api-access-4mxqh\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.880152 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:14:36.879982    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-serving-cert: secret "maas-api-e2e-ipp-a-131718-serving-cert" not found
Nov 01 04:14:36.880152 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:14:36.880066    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls podName:96138547-d4dd-450b-8b63-92753452d3bb nodeName:}" failed. No retries permitted until 2026-11-01 04:14:37.380043929 +0000 UTC m=+1898.139771705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls") pod "maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt" (UID: "96138547-d4dd-450b-8b63-92753452d3bb") : secret "maas-api-e2e-ipp-a-131718-serving-cert" not found
Nov 01 04:14:36.880550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.880527    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96138547-d4dd-450b-8b63-92753452d3bb-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.882525 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.882502    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-metrics-certs\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.941732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.941702    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxqh\" (UniqueName: \"kubernetes.io/projected/96138547-d4dd-450b-8b63-92753452d3bb-kube-api-access-4mxqh\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:36.978333 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:36.978228    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:37.184571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:37.184529    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:37.375377 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:37.375352    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:37.386854 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:37.386824    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:37.389248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:37.389230    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls\") pod \"maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:37.634684 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:37.634603    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:38.024936 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:38.024854    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"]
Nov 01 04:14:38.027513 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:14:38.027482    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96138547_d4dd_450b_8b63_92753452d3bb.slice/crio-0b1ce8967450e01bc04614a5593d295cd8b50cac011637ee829d7ce17e2b9c8d WatchSource:0}: Error finding container 0b1ce8967450e01bc04614a5593d295cd8b50cac011637ee829d7ce17e2b9c8d: Status 404 returned error can't find the container with id 0b1ce8967450e01bc04614a5593d295cd8b50cac011637ee829d7ce17e2b9c8d
Nov 01 04:14:38.029083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:38.029063    5529 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 04:14:38.868896 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:38.868862    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt" event={"ID":"96138547-d4dd-450b-8b63-92753452d3bb","Type":"ContainerStarted","Data":"0b1ce8967450e01bc04614a5593d295cd8b50cac011637ee829d7ce17e2b9c8d"}
Nov 01 04:14:39.878759 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:39.878720    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt" event={"ID":"96138547-d4dd-450b-8b63-92753452d3bb","Type":"ContainerStarted","Data":"ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594"}
Nov 01 04:14:39.879192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:39.878923    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:39.997809 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:39.997749    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt" podStartSLOduration=3.037365875 podStartE2EDuration="3.997731385s" totalImagesPullingTime="960.36551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:14:39.99693454 +0000 UTC m=+1900.756662335" watchObservedRunningTime="2026-11-01 04:14:39.997731385 +0000 UTC m=+1900.757459181"
Nov 01 04:14:42.116012 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:42.115970    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:44.287650 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:14:44.287607    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:14:45.893707 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:45.893673    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:14:47.121533 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:47.121499    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:51.946862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:51.946809    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:53.190135 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:53.190099    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:53.385492 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:53.385459    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:14:57.322241 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:14:57.317617    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:00.194993 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.194957    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"]
Nov 01 04:15:00.200577 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.200543    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:00.214381 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.214353    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"]
Nov 01 04:15:00.218459 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.218428    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:00.259549 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.259509    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6ggdg\""
Nov 01 04:15:00.308722 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.308686    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"]
Nov 01 04:15:00.351918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.351884    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"]
Nov 01 04:15:00.372961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.372915    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l\" (UID: \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:00.373196 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.373005    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fn7c\" (UniqueName: \"kubernetes.io/projected/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-kube-api-access-5fn7c\") pod \"maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l\" (UID: \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:00.373196 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.373138    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd856328-337a-46b4-a92f-2a44b20c5ae7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7\" (UID: \"bd856328-337a-46b4-a92f-2a44b20c5ae7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:00.373352 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.373235    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk4gz\" (UniqueName: \"kubernetes.io/projected/bd856328-337a-46b4-a92f-2a44b20c5ae7-kube-api-access-nk4gz\") pod \"maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7\" (UID: \"bd856328-337a-46b4-a92f-2a44b20c5ae7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:00.474297 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.474203    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l\" (UID: \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:00.474297 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.474297    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fn7c\" (UniqueName: \"kubernetes.io/projected/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-kube-api-access-5fn7c\") pod \"maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l\" (UID: \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:00.474543 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.474351    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd856328-337a-46b4-a92f-2a44b20c5ae7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7\" (UID: \"bd856328-337a-46b4-a92f-2a44b20c5ae7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:00.474543 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.474401    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk4gz\" (UniqueName: \"kubernetes.io/projected/bd856328-337a-46b4-a92f-2a44b20c5ae7-kube-api-access-nk4gz\") pod \"maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7\" (UID: \"bd856328-337a-46b4-a92f-2a44b20c5ae7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:00.474925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.474900    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l\" (UID: \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:00.475096 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.475073    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd856328-337a-46b4-a92f-2a44b20c5ae7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7\" (UID: \"bd856328-337a-46b4-a92f-2a44b20c5ae7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:00.536133 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.536104    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk4gz\" (UniqueName: \"kubernetes.io/projected/bd856328-337a-46b4-a92f-2a44b20c5ae7-kube-api-access-nk4gz\") pod \"maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7\" (UID: \"bd856328-337a-46b4-a92f-2a44b20c5ae7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:00.536339 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.536314    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fn7c\" (UniqueName: \"kubernetes.io/projected/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-kube-api-access-5fn7c\") pod \"maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l\" (UID: \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:00.820595 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.820505    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:00.834614 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:00.834586    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:01.207115 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:01.207081    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"]
Nov 01 04:15:01.249795 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:15:01.249763    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c6b59f_9ce4_408a_9d81_60ab9d4948d0.slice/crio-280d1af9ab0b0bafef14c366578cac13ba419c1e0caae949ea71f1f928df5fb2 WatchSource:0}: Error finding container 280d1af9ab0b0bafef14c366578cac13ba419c1e0caae949ea71f1f928df5fb2: Status 404 returned error can't find the container with id 280d1af9ab0b0bafef14c366578cac13ba419c1e0caae949ea71f1f928df5fb2
Nov 01 04:15:01.260479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:01.260451    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"]
Nov 01 04:15:01.262588 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:15:01.262563    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd856328_337a_46b4_a92f_2a44b20c5ae7.slice/crio-00a377be75cc63bd0edf5382d86d72261288a852a66bc558ae75a70a7406800c WatchSource:0}: Error finding container 00a377be75cc63bd0edf5382d86d72261288a852a66bc558ae75a70a7406800c: Status 404 returned error can't find the container with id 00a377be75cc63bd0edf5382d86d72261288a852a66bc558ae75a70a7406800c
Nov 01 04:15:02.040072 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.040026    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" event={"ID":"39c6b59f-9ce4-408a-9d81-60ab9d4948d0","Type":"ContainerStarted","Data":"b7a9588e0ada2ee2fc94e065a681cb4a52dcc2eeb0060ceaf368031665fe436b"}
Nov 01 04:15:02.040305 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.040101    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" event={"ID":"39c6b59f-9ce4-408a-9d81-60ab9d4948d0","Type":"ContainerStarted","Data":"280d1af9ab0b0bafef14c366578cac13ba419c1e0caae949ea71f1f928df5fb2"}
Nov 01 04:15:02.041589 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.041563    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" event={"ID":"bd856328-337a-46b4-a92f-2a44b20c5ae7","Type":"ContainerStarted","Data":"b971004044abb36341511f6923ad6aedc2cb4da99c51a342dc3991e5bccb4186"}
Nov 01 04:15:02.041730 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.041611    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" event={"ID":"bd856328-337a-46b4-a92f-2a44b20c5ae7","Type":"ContainerStarted","Data":"00a377be75cc63bd0edf5382d86d72261288a852a66bc558ae75a70a7406800c"}
Nov 01 04:15:02.156439 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.156381    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" podStartSLOduration=2.156366219 podStartE2EDuration="2.156366219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:15:02.156018589 +0000 UTC m=+1922.915746381" watchObservedRunningTime="2026-11-01 04:15:02.156366219 +0000 UTC m=+1922.916094013"
Nov 01 04:15:02.274961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.274907    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" podStartSLOduration=2.274893416 podStartE2EDuration="2.274893416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:15:02.272314987 +0000 UTC m=+1923.032042783" watchObservedRunningTime="2026-11-01 04:15:02.274893416 +0000 UTC m=+1923.034621210"
Nov 01 04:15:02.494190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.494120    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:02.717245 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.717215    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:02.929820 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:02.929787    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:03.050643 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:03.050600    5529 generic.go:356] "Generic (PLEG): container finished" podID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerID="b7a9588e0ada2ee2fc94e065a681cb4a52dcc2eeb0060ceaf368031665fe436b" exitCode=60
Nov 01 04:15:03.050842 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:03.050690    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" event={"ID":"39c6b59f-9ce4-408a-9d81-60ab9d4948d0","Type":"ContainerDied","Data":"b7a9588e0ada2ee2fc94e065a681cb4a52dcc2eeb0060ceaf368031665fe436b"}
Nov 01 04:15:03.050991 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:03.050972    5529 scope.go:122] "RemoveContainer" containerID="b7a9588e0ada2ee2fc94e065a681cb4a52dcc2eeb0060ceaf368031665fe436b"
Nov 01 04:15:03.052464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:03.052439    5529 generic.go:356] "Generic (PLEG): container finished" podID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerID="b971004044abb36341511f6923ad6aedc2cb4da99c51a342dc3991e5bccb4186" exitCode=60
Nov 01 04:15:03.052606 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:03.052479    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" event={"ID":"bd856328-337a-46b4-a92f-2a44b20c5ae7","Type":"ContainerDied","Data":"b971004044abb36341511f6923ad6aedc2cb4da99c51a342dc3991e5bccb4186"}
Nov 01 04:15:03.052739 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:03.052723    5529 scope.go:122] "RemoveContainer" containerID="b971004044abb36341511f6923ad6aedc2cb4da99c51a342dc3991e5bccb4186"
Nov 01 04:15:04.062764 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:04.062734    5529 generic.go:356] "Generic (PLEG): container finished" podID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerID="4ac622719b8a3b825d8973ae6d86774c757dcacb280de6c092542f60b09e44c5" exitCode=60
Nov 01 04:15:04.063301 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:04.062821    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" event={"ID":"39c6b59f-9ce4-408a-9d81-60ab9d4948d0","Type":"ContainerDied","Data":"4ac622719b8a3b825d8973ae6d86774c757dcacb280de6c092542f60b09e44c5"}
Nov 01 04:15:04.063301 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:04.062905    5529 scope.go:122] "RemoveContainer" containerID="b7a9588e0ada2ee2fc94e065a681cb4a52dcc2eeb0060ceaf368031665fe436b"
Nov 01 04:15:04.063410 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:04.063331    5529 scope.go:122] "RemoveContainer" containerID="4ac622719b8a3b825d8973ae6d86774c757dcacb280de6c092542f60b09e44c5"
Nov 01 04:15:04.063687 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:04.063663    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l_odh-ai-gateway-infra(39c6b59f-9ce4-408a-9d81-60ab9d4948d0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0"
Nov 01 04:15:04.065044 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:04.065014    5529 generic.go:356] "Generic (PLEG): container finished" podID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerID="13c8caee8c5a75f97015198bb4801fd0a74f5aa7a139cc166930953c7063d335" exitCode=60
Nov 01 04:15:04.065176 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:04.065065    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" event={"ID":"bd856328-337a-46b4-a92f-2a44b20c5ae7","Type":"ContainerDied","Data":"13c8caee8c5a75f97015198bb4801fd0a74f5aa7a139cc166930953c7063d335"}
Nov 01 04:15:04.065401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:04.065386    5529 scope.go:122] "RemoveContainer" containerID="13c8caee8c5a75f97015198bb4801fd0a74f5aa7a139cc166930953c7063d335"
Nov 01 04:15:04.065666 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:04.065647    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7_odh-ai-gateway-infra(bd856328-337a-46b4-a92f-2a44b20c5ae7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7"
Nov 01 04:15:04.077265 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:04.077242    5529 scope.go:122] "RemoveContainer" containerID="b971004044abb36341511f6923ad6aedc2cb4da99c51a342dc3991e5bccb4186"
Nov 01 04:15:05.073736 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:05.073706    5529 scope.go:122] "RemoveContainer" containerID="4ac622719b8a3b825d8973ae6d86774c757dcacb280de6c092542f60b09e44c5"
Nov 01 04:15:05.074198 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:05.074051    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l_odh-ai-gateway-infra(39c6b59f-9ce4-408a-9d81-60ab9d4948d0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0"
Nov 01 04:15:05.075562 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:05.075537    5529 scope.go:122] "RemoveContainer" containerID="13c8caee8c5a75f97015198bb4801fd0a74f5aa7a139cc166930953c7063d335"
Nov 01 04:15:05.075825 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:05.075804    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7_odh-ai-gateway-infra(bd856328-337a-46b4-a92f-2a44b20c5ae7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7"
Nov 01 04:15:07.698505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.698467    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"]
Nov 01 04:15:07.703853 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.703830    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.757218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.757182    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"]
Nov 01 04:15:07.766637 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.766598    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5p9h\" (UniqueName: \"kubernetes.io/projected/445c6383-28c5-4555-9f3c-5288722858b3-kube-api-access-s5p9h\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.766795 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.766656    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.766862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.766844    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.766922 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.766903    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445c6383-28c5-4555-9f3c-5288722858b3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.868148 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.868112    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5p9h\" (UniqueName: \"kubernetes.io/projected/445c6383-28c5-4555-9f3c-5288722858b3-kube-api-access-s5p9h\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.868369 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.868198    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.868369 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.868296    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.868369 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.868345    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445c6383-28c5-4555-9f3c-5288722858b3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.869524 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.869493    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445c6383-28c5-4555-9f3c-5288722858b3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.871642 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.871582    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.879234 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.871938    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:07.929829 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:07.929791    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5p9h\" (UniqueName: \"kubernetes.io/projected/445c6383-28c5-4555-9f3c-5288722858b3-kube-api-access-s5p9h\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:08.017585 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:08.017478    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:08.117052 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:08.117015    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:08.402276 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:08.402248    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"]
Nov 01 04:15:08.403229 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:15:08.403204    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445c6383_28c5_4555_9f3c_5288722858b3.slice/crio-fa726d763a86a65e4eabaed0e35377b1be77ee8811872066faf4c1a6bf82d63f WatchSource:0}: Error finding container fa726d763a86a65e4eabaed0e35377b1be77ee8811872066faf4c1a6bf82d63f: Status 404 returned error can't find the container with id fa726d763a86a65e4eabaed0e35377b1be77ee8811872066faf4c1a6bf82d63f
Nov 01 04:15:09.132771 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:09.132728    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj" event={"ID":"445c6383-28c5-4555-9f3c-5288722858b3","Type":"ContainerStarted","Data":"fa726d763a86a65e4eabaed0e35377b1be77ee8811872066faf4c1a6bf82d63f"}
Nov 01 04:15:10.143154 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:10.143105    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj" event={"ID":"445c6383-28c5-4555-9f3c-5288722858b3","Type":"ContainerStarted","Data":"9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d"}
Nov 01 04:15:10.143693 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:10.143348    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:10.264272 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:10.264217    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj" podStartSLOduration=2.396723881 podStartE2EDuration="3.264202806s" totalImagesPullingTime="867.478925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:15:10.261417836 +0000 UTC m=+1931.021145630" watchObservedRunningTime="2026-11-01 04:15:10.264202806 +0000 UTC m=+1931.023930600"
Nov 01 04:15:12.002925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:12.002890    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:13.211085 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:13.211050    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:14.284342 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:14.284301    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:15:14.366879 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:14.366848    5529 scope.go:122] "RemoveContainer" containerID="13c8caee8c5a75f97015198bb4801fd0a74f5aa7a139cc166930953c7063d335"
Nov 01 04:15:15.178381 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:15.178347    5529 generic.go:356] "Generic (PLEG): container finished" podID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerID="80f6d3072177a2c23c7e075344b36bc22027f39ac8762f61c8adc5f739c211c2" exitCode=60
Nov 01 04:15:15.178555 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:15.178425    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" event={"ID":"bd856328-337a-46b4-a92f-2a44b20c5ae7","Type":"ContainerDied","Data":"80f6d3072177a2c23c7e075344b36bc22027f39ac8762f61c8adc5f739c211c2"}
Nov 01 04:15:15.178555 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:15.178496    5529 scope.go:122] "RemoveContainer" containerID="13c8caee8c5a75f97015198bb4801fd0a74f5aa7a139cc166930953c7063d335"
Nov 01 04:15:15.178864 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:15.178849    5529 scope.go:122] "RemoveContainer" containerID="80f6d3072177a2c23c7e075344b36bc22027f39ac8762f61c8adc5f739c211c2"
Nov 01 04:15:15.179194 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:15.179153    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7_odh-ai-gateway-infra(bd856328-337a-46b4-a92f-2a44b20c5ae7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7"
Nov 01 04:15:16.155134 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.155102    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:15:16.329088 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.329036    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"]
Nov 01 04:15:16.333953 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.333924    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"]
Nov 01 04:15:16.334179 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.334142    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj" podUID="ab8bd138-7977-4f68-9bd7-dfde9536315a" containerName="maas-api" containerID="cri-o://14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f" gracePeriod=30
Nov 01 04:15:16.522400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.522368    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:16.635229 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.634914    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:16.719281 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.719232    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd856328-337a-46b4-a92f-2a44b20c5ae7-kube-api-access-nk4gz\" (UniqueName: \"kubernetes.io/projected/bd856328-337a-46b4-a92f-2a44b20c5ae7-kube-api-access-nk4gz\") pod \"bd856328-337a-46b4-a92f-2a44b20c5ae7\" (UID: \"bd856328-337a-46b4-a92f-2a44b20c5ae7\") "
Nov 01 04:15:16.719539 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.719515    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd856328-337a-46b4-a92f-2a44b20c5ae7-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd856328-337a-46b4-a92f-2a44b20c5ae7-maas-api-service-ca\") pod \"bd856328-337a-46b4-a92f-2a44b20c5ae7\" (UID: \"bd856328-337a-46b4-a92f-2a44b20c5ae7\") "
Nov 01 04:15:16.720296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.720267    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd856328-337a-46b4-a92f-2a44b20c5ae7-maas-api-service-ca" pod "bd856328-337a-46b4-a92f-2a44b20c5ae7" (UID: "bd856328-337a-46b4-a92f-2a44b20c5ae7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:15:16.722842 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.722816    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd856328-337a-46b4-a92f-2a44b20c5ae7-kube-api-access-nk4gz" pod "bd856328-337a-46b4-a92f-2a44b20c5ae7" (UID: "bd856328-337a-46b4-a92f-2a44b20c5ae7"). InnerVolumeSpecName "kube-api-access-nk4gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:15:16.757801 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.757775    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:15:16.837241 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.837118    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd856328-337a-46b4-a92f-2a44b20c5ae7-maas-api-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:15:16.837241 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.837202    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk4gz\" (UniqueName: \"kubernetes.io/projected/bd856328-337a-46b4-a92f-2a44b20c5ae7-kube-api-access-nk4gz\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:15:16.940624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.940590    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab8bd138-7977-4f68-9bd7-dfde9536315a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8bd138-7977-4f68-9bd7-dfde9536315a-openshift-service-ca\") pod \"ab8bd138-7977-4f68-9bd7-dfde9536315a\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") "
Nov 01 04:15:16.940624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.940628    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-metrics-certs\") pod \"ab8bd138-7977-4f68-9bd7-dfde9536315a\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") "
Nov 01 04:15:16.940907 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.940694    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab8bd138-7977-4f68-9bd7-dfde9536315a-kube-api-access-777fs\" (UniqueName: \"kubernetes.io/projected/ab8bd138-7977-4f68-9bd7-dfde9536315a-kube-api-access-777fs\") pod \"ab8bd138-7977-4f68-9bd7-dfde9536315a\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") "
Nov 01 04:15:16.940907 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.940815    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls\") pod \"ab8bd138-7977-4f68-9bd7-dfde9536315a\" (UID: \"ab8bd138-7977-4f68-9bd7-dfde9536315a\") "
Nov 01 04:15:16.941191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.941111    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab8bd138-7977-4f68-9bd7-dfde9536315a-openshift-service-ca" pod "ab8bd138-7977-4f68-9bd7-dfde9536315a" (UID: "ab8bd138-7977-4f68-9bd7-dfde9536315a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:15:16.941470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.941444    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab8bd138-7977-4f68-9bd7-dfde9536315a-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:15:16.943362 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.943333    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-metrics-certs" pod "ab8bd138-7977-4f68-9bd7-dfde9536315a" (UID: "ab8bd138-7977-4f68-9bd7-dfde9536315a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:15:16.943362 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.943351    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls" pod "ab8bd138-7977-4f68-9bd7-dfde9536315a" (UID: "ab8bd138-7977-4f68-9bd7-dfde9536315a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:15:16.943534 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:16.943418    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8bd138-7977-4f68-9bd7-dfde9536315a-kube-api-access-777fs" pod "ab8bd138-7977-4f68-9bd7-dfde9536315a" (UID: "ab8bd138-7977-4f68-9bd7-dfde9536315a"). InnerVolumeSpecName "kube-api-access-777fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:15:17.042585 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.042551    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-777fs\" (UniqueName: \"kubernetes.io/projected/ab8bd138-7977-4f68-9bd7-dfde9536315a-kube-api-access-777fs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:15:17.042585 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.042583    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:15:17.042585 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.042592    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab8bd138-7977-4f68-9bd7-dfde9536315a-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:15:17.194726 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.194694    5529 generic.go:356] "Generic (PLEG): container finished" podID="ab8bd138-7977-4f68-9bd7-dfde9536315a" containerID="14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f" exitCode=0
Nov 01 04:15:17.195227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.194740    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"
Nov 01 04:15:17.195227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.194777    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj" event={"ID":"ab8bd138-7977-4f68-9bd7-dfde9536315a","Type":"ContainerDied","Data":"14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f"}
Nov 01 04:15:17.195227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.194823    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj" event={"ID":"ab8bd138-7977-4f68-9bd7-dfde9536315a","Type":"ContainerDied","Data":"f230dca2d3df18929fa7740f6bcbbf6394f9bee95d184cff7380f19767e59017"}
Nov 01 04:15:17.195227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.194844    5529 scope.go:122] "RemoveContainer" containerID="14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f"
Nov 01 04:15:17.196593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.196564    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7" event={"ID":"bd856328-337a-46b4-a92f-2a44b20c5ae7","Type":"ContainerDied","Data":"00a377be75cc63bd0edf5382d86d72261288a852a66bc558ae75a70a7406800c"}
Nov 01 04:15:17.196706 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.196624    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"
Nov 01 04:15:17.206218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.206200    5529 scope.go:122] "RemoveContainer" containerID="14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f"
Nov 01 04:15:17.206526 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:17.206507    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f\": container with ID starting with 14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f not found: ID does not exist" containerID="14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f"
Nov 01 04:15:17.206594 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.206536    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f"} err="failed to get container status \"14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f\": rpc error: code = NotFound desc = could not find container \"14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f\": container with ID starting with 14f7f4714f4e19503defb904a05518b9aa361f44dbd41a3e6bd064137379249f not found: ID does not exist"
Nov 01 04:15:17.206594 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.206552    5529 scope.go:122] "RemoveContainer" containerID="80f6d3072177a2c23c7e075344b36bc22027f39ac8762f61c8adc5f739c211c2"
Nov 01 04:15:17.361861 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.361828    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"]
Nov 01 04:15:17.373308 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.373280    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-131718-29891775-tcll7"]
Nov 01 04:15:17.373879 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.373863    5529 scope.go:122] "RemoveContainer" containerID="4ac622719b8a3b825d8973ae6d86774c757dcacb280de6c092542f60b09e44c5"
Nov 01 04:15:17.479941 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.479853    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"]
Nov 01 04:15:17.488650 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:17.488618    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-866gj"]
Nov 01 04:15:18.205448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:18.205375    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" event={"ID":"39c6b59f-9ce4-408a-9d81-60ab9d4948d0","Type":"ContainerStarted","Data":"f1d518361c04e3e11abcce648915aeab9d7287af35a9d8eef70f8de4d3684275"}
Nov 01 04:15:18.389633 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:18.389599    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:19.258849 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:19.258800    5529 generic.go:356] "Generic (PLEG): container finished" podID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerID="f1d518361c04e3e11abcce648915aeab9d7287af35a9d8eef70f8de4d3684275" exitCode=60
Nov 01 04:15:19.259429 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:19.259065    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" event={"ID":"39c6b59f-9ce4-408a-9d81-60ab9d4948d0","Type":"ContainerDied","Data":"f1d518361c04e3e11abcce648915aeab9d7287af35a9d8eef70f8de4d3684275"}
Nov 01 04:15:19.259429 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:19.259130    5529 scope.go:122] "RemoveContainer" containerID="4ac622719b8a3b825d8973ae6d86774c757dcacb280de6c092542f60b09e44c5"
Nov 01 04:15:19.268193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:19.259923    5529 scope.go:122] "RemoveContainer" containerID="f1d518361c04e3e11abcce648915aeab9d7287af35a9d8eef70f8de4d3684275"
Nov 01 04:15:19.268193 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:19.260316    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l_odh-ai-gateway-infra(39c6b59f-9ce4-408a-9d81-60ab9d4948d0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0"
Nov 01 04:15:19.378751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:19.378723    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab8bd138-7977-4f68-9bd7-dfde9536315a" path="/var/lib/kubelet/pods/ab8bd138-7977-4f68-9bd7-dfde9536315a/volumes"
Nov 01 04:15:19.379574 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:19.379550    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" path="/var/lib/kubelet/pods/bd856328-337a-46b4-a92f-2a44b20c5ae7/volumes"
Nov 01 04:15:19.380130 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:19.380112    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"]
Nov 01 04:15:20.582070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:20.581998    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:20.675851 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:20.675803    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-kube-api-access-5fn7c\" (UniqueName: \"kubernetes.io/projected/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-kube-api-access-5fn7c\") pod \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\" (UID: \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\") "
Nov 01 04:15:20.676059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:20.675872    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-maas-api-service-ca\") pod \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\" (UID: \"39c6b59f-9ce4-408a-9d81-60ab9d4948d0\") "
Nov 01 04:15:20.676386 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:20.676347    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-maas-api-service-ca" pod "39c6b59f-9ce4-408a-9d81-60ab9d4948d0" (UID: "39c6b59f-9ce4-408a-9d81-60ab9d4948d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:15:20.677032 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:20.677013    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-maas-api-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:15:20.678057 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:20.678034    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-kube-api-access-5fn7c" pod "39c6b59f-9ce4-408a-9d81-60ab9d4948d0" (UID: "39c6b59f-9ce4-408a-9d81-60ab9d4948d0"). InnerVolumeSpecName "kube-api-access-5fn7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:15:20.779185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:20.779072    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fn7c\" (UniqueName: \"kubernetes.io/projected/39c6b59f-9ce4-408a-9d81-60ab9d4948d0-kube-api-access-5fn7c\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:15:21.290070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:21.290039    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l" event={"ID":"39c6b59f-9ce4-408a-9d81-60ab9d4948d0","Type":"ContainerDied","Data":"280d1af9ab0b0bafef14c366578cac13ba419c1e0caae949ea71f1f928df5fb2"}
Nov 01 04:15:21.290268 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:21.290083    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"
Nov 01 04:15:21.290268 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:21.290098    5529 scope.go:122] "RemoveContainer" containerID="f1d518361c04e3e11abcce648915aeab9d7287af35a9d8eef70f8de4d3684275"
Nov 01 04:15:21.477271 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:21.477230    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"]
Nov 01 04:15:21.477873 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:21.477854    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-865066-29891775-dwj2l"]
Nov 01 04:15:22.076376 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:22.076335    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:22.379664 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:22.379633    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:23.374953 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:23.374912    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" path="/var/lib/kubelet/pods/39c6b59f-9ce4-408a-9d81-60ab9d4948d0/volumes"
Nov 01 04:15:23.741149 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:23.741115    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:25.576376 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:25.576335    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 01 04:15:25.576841 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:25.576401    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 01 04:15:26.340130 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:26.340040    5529 generic.go:356] "Generic (PLEG): container finished" podID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerID="7492f082d5476ae0220930e064be814bcf5c679eb5ced896e2ef991f628e7d90" exitCode=0
Nov 01 04:15:26.340371 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:26.340124    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" event={"ID":"bd637ff4-9c68-40f4-9efa-654bedbf4206","Type":"ContainerDied","Data":"7492f082d5476ae0220930e064be814bcf5c679eb5ced896e2ef991f628e7d90"}
Nov 01 04:15:26.340717 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:26.340698    5529 scope.go:122] "RemoveContainer" containerID="7492f082d5476ae0220930e064be814bcf5c679eb5ced896e2ef991f628e7d90"
Nov 01 04:15:26.342486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:26.342445    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:15:26.342613 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:26.342541    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:15:26.342613 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:26.342579    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:15:27.375766 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.375730    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" event={"ID":"bd637ff4-9c68-40f4-9efa-654bedbf4206","Type":"ContainerStarted","Data":"2397cd24f96c94853aead947ad28c114886ef3ee7de659571e893615c3119908"}
Nov 01 04:15:27.376283 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.376251    5529 generic.go:356] "Generic (PLEG): container finished" podID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerID="4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df" exitCode=0
Nov 01 04:15:27.376361 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.376334    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" event={"ID":"c7fcb708-5355-4d46-9c90-f7c596e8542a","Type":"ContainerDied","Data":"4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df"}
Nov 01 04:15:27.376676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.376660    5529 scope.go:122] "RemoveContainer" containerID="4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df"
Nov 01 04:15:27.377947 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.377920    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:15:27.378000 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.377984    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:15:27.378038 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.378018    5529 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236064Ki","pods":"250"}
Nov 01 04:15:27.403335 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.403301    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:15:27.403529 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.403503    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Nov 01 04:15:27.403598 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:27.403576    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Nov 01 04:15:28.391695 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:28.391663    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" event={"ID":"c7fcb708-5355-4d46-9c90-f7c596e8542a","Type":"ContainerStarted","Data":"adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4"}
Nov 01 04:15:28.403861 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:28.403715    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Nov 01 04:15:28.403861 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:28.403776    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Nov 01 04:15:28.977710 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:28.977668    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:15:28.978082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:28.978059    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Nov 01 04:15:28.978128 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:28.978108    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Nov 01 04:15:29.107710 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:29.107673    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:29.403917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:29.403877    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Nov 01 04:15:29.404453 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:29.403926    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Nov 01 04:15:29.978471 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:29.978429    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Nov 01 04:15:29.978687 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:29.978491    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Nov 01 04:15:30.403479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:30.403433    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Nov 01 04:15:30.403662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:30.403496    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Nov 01 04:15:30.979224 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:30.979191    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Nov 01 04:15:30.979684 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:30.979661    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Nov 01 04:15:31.403268 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:31.403237    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Nov 01 04:15:31.403443 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:31.403288    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Nov 01 04:15:31.977779 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:31.977628    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Nov 01 04:15:31.977779 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:31.977675    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Nov 01 04:15:32.403545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:32.403508    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Nov 01 04:15:32.404036 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:32.404011    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Nov 01 04:15:32.978860 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:32.978828    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Nov 01 04:15:32.979047 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:32.978888    5529 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Nov 01 04:15:33.408582 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:33.408550    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:15:33.409045 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:33.409026    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:15:33.409708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:33.409687    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:15:33.981866 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:33.981836    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:15:33.982300 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:33.982281    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:15:33.983025 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:33.983006    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:15:34.258270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:34.258185    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:36.018373 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:36.018328    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:41.122413 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:41.122362    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:42.711437 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:42.711402    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:43.388819 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:43.388776    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:43.620576 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:43.620530    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:44.285508 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:15:44.285476    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:15:47.981261 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:47.981228    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:48.187786 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:48.187745    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:51.160007 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.159973    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:51.363899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.363858    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:51.511014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.510927    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"]
Nov 01 04:15:51.511494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511480    5529 cpu_manager.go:414] "containerMap: removing container" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:15:51.511551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511495    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:15:51.511551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511509    5529 cpu_manager.go:414] "containerMap: removing container" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:15:51.511551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511514    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:15:51.511551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511532    5529 cpu_manager.go:414] "containerMap: removing container" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:15:51.511551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511538    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:15:51.511551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511546    5529 cpu_manager.go:414] "containerMap: removing container" podUID="ab8bd138-7977-4f68-9bd7-dfde9536315a" containerName="maas-api"
Nov 01 04:15:51.511551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511550    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab8bd138-7977-4f68-9bd7-dfde9536315a" containerName="maas-api"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511558    5529 cpu_manager.go:414] "containerMap: removing container" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511563    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511574    5529 cpu_manager.go:414] "containerMap: removing container" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511579    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511667    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511676    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511682    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511690    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab8bd138-7977-4f68-9bd7-dfde9536315a" containerName="maas-api"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511694    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:15:51.511762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.511701    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:15:51.514930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.514910    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:51.573888 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.573837    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"]
Nov 01 04:15:51.619737 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.617135    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gg84\" (UniqueName: \"kubernetes.io/projected/b5354296-d342-458b-bbf3-6372f3b36959-kube-api-access-4gg84\") pod \"payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5\" (UID: \"b5354296-d342-458b-bbf3-6372f3b36959\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:51.619737 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.617245    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5354296-d342-458b-bbf3-6372f3b36959-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5\" (UID: \"b5354296-d342-458b-bbf3-6372f3b36959\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:51.621061 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.621037    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-3a348f\""
Nov 01 04:15:51.623251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.623231    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-3a348f-dockercfg-lpsff\""
Nov 01 04:15:51.718185 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.718138    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gg84\" (UniqueName: \"kubernetes.io/projected/b5354296-d342-458b-bbf3-6372f3b36959-kube-api-access-4gg84\") pod \"payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5\" (UID: \"b5354296-d342-458b-bbf3-6372f3b36959\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:51.718358 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.718238    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5354296-d342-458b-bbf3-6372f3b36959-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5\" (UID: \"b5354296-d342-458b-bbf3-6372f3b36959\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:51.718953 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.718934    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5354296-d342-458b-bbf3-6372f3b36959-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5\" (UID: \"b5354296-d342-458b-bbf3-6372f3b36959\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:51.779666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.779581    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gg84\" (UniqueName: \"kubernetes.io/projected/b5354296-d342-458b-bbf3-6372f3b36959-kube-api-access-4gg84\") pod \"payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5\" (UID: \"b5354296-d342-458b-bbf3-6372f3b36959\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:51.828119 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:51.828084    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:52.205589 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:52.205559    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"]
Nov 01 04:15:52.207559 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:15:52.207527    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5354296_d342_458b_bbf3_6372f3b36959.slice/crio-c38609d845785dd75030ae863da67c2bc35f335c6822ee574982bc899aa5e0f4 WatchSource:0}: Error finding container c38609d845785dd75030ae863da67c2bc35f335c6822ee574982bc899aa5e0f4: Status 404 returned error can't find the container with id c38609d845785dd75030ae863da67c2bc35f335c6822ee574982bc899aa5e0f4
Nov 01 04:15:52.682157 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:52.682116    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5" event={"ID":"b5354296-d342-458b-bbf3-6372f3b36959","Type":"ContainerStarted","Data":"7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df"}
Nov 01 04:15:52.682389 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:52.682199    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5" event={"ID":"b5354296-d342-458b-bbf3-6372f3b36959","Type":"ContainerStarted","Data":"c38609d845785dd75030ae863da67c2bc35f335c6822ee574982bc899aa5e0f4"}
Nov 01 04:15:52.683131 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:52.683111    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:15:52.802091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:52.802030    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5" podStartSLOduration=1.802014877 podStartE2EDuration="1.802014877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:15:52.798690656 +0000 UTC m=+1973.558418452" watchObservedRunningTime="2026-11-01 04:15:52.802014877 +0000 UTC m=+1973.561742672"
Nov 01 04:15:53.465376 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:53.465338    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:56.507831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:56.507793    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"]
Nov 01 04:15:56.668230 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:56.668186    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:56.902093 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:56.902056    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:57.106545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:57.106515    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:15:58.862958 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:15:58.862678    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:01.508604 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.508564    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx" podUID="e2b8b900-6c7c-444e-9150-f4ed8ab39e67" containerName="payload-processing" containerID="cri-o://75b57f69f3628983c46cf2058303137e3f64b2daddf5449554b3ab8e54628b35" gracePeriod=25
Nov 01 04:16:01.760443 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.760354    5529 generic.go:356] "Generic (PLEG): container finished" podID="e2b8b900-6c7c-444e-9150-f4ed8ab39e67" containerID="75b57f69f3628983c46cf2058303137e3f64b2daddf5449554b3ab8e54628b35" exitCode=0
Nov 01 04:16:01.760618 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.760441    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx" event={"ID":"e2b8b900-6c7c-444e-9150-f4ed8ab39e67","Type":"ContainerDied","Data":"75b57f69f3628983c46cf2058303137e3f64b2daddf5449554b3ab8e54628b35"}
Nov 01 04:16:01.797782 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.797754    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:16:01.946518 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.946483    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-kube-api-access-h4qdh\" (UniqueName: \"kubernetes.io/projected/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-kube-api-access-h4qdh\") pod \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\" (UID: \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\") "
Nov 01 04:16:01.946891 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.946866    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-plugins-config-volume\") pod \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\" (UID: \"e2b8b900-6c7c-444e-9150-f4ed8ab39e67\") "
Nov 01 04:16:01.947263 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.947240    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-plugins-config-volume" pod "e2b8b900-6c7c-444e-9150-f4ed8ab39e67" (UID: "e2b8b900-6c7c-444e-9150-f4ed8ab39e67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:16:01.947371 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.947355    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:16:01.949439 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:01.949410    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-kube-api-access-h4qdh" pod "e2b8b900-6c7c-444e-9150-f4ed8ab39e67" (UID: "e2b8b900-6c7c-444e-9150-f4ed8ab39e67"). InnerVolumeSpecName "kube-api-access-h4qdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:16:02.048720 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:02.048629    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4qdh\" (UniqueName: \"kubernetes.io/projected/e2b8b900-6c7c-444e-9150-f4ed8ab39e67-kube-api-access-h4qdh\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:16:02.768108 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:02.768075    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"
Nov 01 04:16:02.768589 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:02.768085    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx" event={"ID":"e2b8b900-6c7c-444e-9150-f4ed8ab39e67","Type":"ContainerDied","Data":"953d6baa1c1f926cb4d1fc0769b632686ef3510aab4b3aab1d0b489489765c28"}
Nov 01 04:16:02.768589 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:02.768247    5529 scope.go:122] "RemoveContainer" containerID="75b57f69f3628983c46cf2058303137e3f64b2daddf5449554b3ab8e54628b35"
Nov 01 04:16:02.934482 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:02.934439    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"]
Nov 01 04:16:02.984314 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:02.984278    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-131718-99f467587-47lnx"]
Nov 01 04:16:03.373643 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:03.373611    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e2b8b900-6c7c-444e-9150-f4ed8ab39e67" path="/var/lib/kubelet/pods/e2b8b900-6c7c-444e-9150-f4ed8ab39e67/volumes"
Nov 01 04:16:04.190929 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:04.190899    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:04.707597 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:04.707569    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:16:05.373709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:05.373675    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:05.986976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:05.986923    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:06.369910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:06.369771    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:09.581556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:09.581470    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:10.876627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:10.876588    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:11.096575 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:11.096529    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:11.297915 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:11.297839    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:12.350265 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:12.350231    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:14.284825 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:16:14.284788    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:16:14.360481 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.360446    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:14.562723 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.562643    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:14.628584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.628552    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"]
Nov 01 04:16:14.629102 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.629088    5529 cpu_manager.go:414] "containerMap: removing container" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:16:14.629144 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.629104    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39c6b59f-9ce4-408a-9d81-60ab9d4948d0" containerName="cleanup"
Nov 01 04:16:14.629144 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.629120    5529 cpu_manager.go:414] "containerMap: removing container" podUID="e2b8b900-6c7c-444e-9150-f4ed8ab39e67" containerName="payload-processing"
Nov 01 04:16:14.629144 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.629126    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e2b8b900-6c7c-444e-9150-f4ed8ab39e67" containerName="payload-processing"
Nov 01 04:16:14.629299 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.629242    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd856328-337a-46b4-a92f-2a44b20c5ae7" containerName="cleanup"
Nov 01 04:16:14.629299 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.629255    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="e2b8b900-6c7c-444e-9150-f4ed8ab39e67" containerName="payload-processing"
Nov 01 04:16:14.633800 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.633780    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:14.687114 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.687082    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"]
Nov 01 04:16:14.732187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.731886    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxg9s\" (UniqueName: \"kubernetes.io/projected/448d4f5b-0dd0-4a88-97ba-669c487fd84e-kube-api-access-jxg9s\") pod \"payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz\" (UID: \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:14.732187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.732095    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/448d4f5b-0dd0-4a88-97ba-669c487fd84e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz\" (UID: \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:14.763025 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.749521    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-601a4b-dockercfg-v5lps\""
Nov 01 04:16:14.763025 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.749590    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-601a4b\""
Nov 01 04:16:14.775234 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.774874    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:14.778852 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.778826    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"]
Nov 01 04:16:14.783725 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.783698    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:14.832918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.832831    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxg9s\" (UniqueName: \"kubernetes.io/projected/448d4f5b-0dd0-4a88-97ba-669c487fd84e-kube-api-access-jxg9s\") pod \"payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz\" (UID: \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:14.833089 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.832959    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcaeecbf-2334-4389-8055-42efe9618e02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44\" (UID: \"dcaeecbf-2334-4389-8055-42efe9618e02\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:14.833089 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.833025    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jpj\" (UniqueName: \"kubernetes.io/projected/dcaeecbf-2334-4389-8055-42efe9618e02-kube-api-access-t7jpj\") pod \"payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44\" (UID: \"dcaeecbf-2334-4389-8055-42efe9618e02\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:14.833203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.833094    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/448d4f5b-0dd0-4a88-97ba-669c487fd84e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz\" (UID: \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:14.833856 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.833830    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/448d4f5b-0dd0-4a88-97ba-669c487fd84e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz\" (UID: \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:14.836652 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.836632    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"]
Nov 01 04:16:14.894418 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.894382    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxg9s\" (UniqueName: \"kubernetes.io/projected/448d4f5b-0dd0-4a88-97ba-669c487fd84e-kube-api-access-jxg9s\") pod \"payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz\" (UID: \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:14.934191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.934131    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcaeecbf-2334-4389-8055-42efe9618e02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44\" (UID: \"dcaeecbf-2334-4389-8055-42efe9618e02\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:14.934373 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.934215    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jpj\" (UniqueName: \"kubernetes.io/projected/dcaeecbf-2334-4389-8055-42efe9618e02-kube-api-access-t7jpj\") pod \"payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44\" (UID: \"dcaeecbf-2334-4389-8055-42efe9618e02\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:14.935037 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.935007    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcaeecbf-2334-4389-8055-42efe9618e02-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44\" (UID: \"dcaeecbf-2334-4389-8055-42efe9618e02\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:14.948412 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.948375    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:14.974086 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.974044    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:14.997103 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:14.997073    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jpj\" (UniqueName: \"kubernetes.io/projected/dcaeecbf-2334-4389-8055-42efe9618e02-kube-api-access-t7jpj\") pod \"payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44\" (UID: \"dcaeecbf-2334-4389-8055-42efe9618e02\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:15.099494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.099389    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:15.352403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.352376    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"]
Nov 01 04:16:15.355060 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:16:15.355032    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448d4f5b_0dd0_4a88_97ba_669c487fd84e.slice/crio-8796ecad2d9281f6b411e4c38ebf85d2546411f3de929f6826f50d0900d19ff9 WatchSource:0}: Error finding container 8796ecad2d9281f6b411e4c38ebf85d2546411f3de929f6826f50d0900d19ff9: Status 404 returned error can't find the container with id 8796ecad2d9281f6b411e4c38ebf85d2546411f3de929f6826f50d0900d19ff9
Nov 01 04:16:15.485198 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.483780    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"]
Nov 01 04:16:15.494498 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:16:15.494465    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcaeecbf_2334_4389_8055_42efe9618e02.slice/crio-4676a9727b9719a5112a075018b0063d2476087c46d294020d253f65019b0297 WatchSource:0}: Error finding container 4676a9727b9719a5112a075018b0063d2476087c46d294020d253f65019b0297: Status 404 returned error can't find the container with id 4676a9727b9719a5112a075018b0063d2476087c46d294020d253f65019b0297
Nov 01 04:16:15.603243 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.591832    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:15.870403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.869093    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44" event={"ID":"dcaeecbf-2334-4389-8055-42efe9618e02","Type":"ContainerStarted","Data":"755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961"}
Nov 01 04:16:15.870403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.869217    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44" event={"ID":"dcaeecbf-2334-4389-8055-42efe9618e02","Type":"ContainerStarted","Data":"4676a9727b9719a5112a075018b0063d2476087c46d294020d253f65019b0297"}
Nov 01 04:16:15.870403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.869338    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:15.871014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.870990    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz" event={"ID":"448d4f5b-0dd0-4a88-97ba-669c487fd84e","Type":"ContainerStarted","Data":"53a8a7824bcdb6889d23229e6cf8e695d05cf5018e6456af26e59d63868ab363"}
Nov 01 04:16:15.871098 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.871033    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz" event={"ID":"448d4f5b-0dd0-4a88-97ba-669c487fd84e","Type":"ContainerStarted","Data":"8796ecad2d9281f6b411e4c38ebf85d2546411f3de929f6826f50d0900d19ff9"}
Nov 01 04:16:15.871098 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.871083    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:15.986296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:15.986244    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44" podStartSLOduration=1.98623059 podStartE2EDuration="1.98623059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:16:15.985296366 +0000 UTC m=+1996.745024161" watchObservedRunningTime="2026-11-01 04:16:15.98623059 +0000 UTC m=+1996.745958435"
Nov 01 04:16:16.103945 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:16.103887    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz" podStartSLOduration=2.103871451 podStartE2EDuration="2.103871451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:16:16.10089753 +0000 UTC m=+1996.860625338" watchObservedRunningTime="2026-11-01 04:16:16.103871451 +0000 UTC m=+1996.863599245"
Nov 01 04:16:17.906630 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:17.906588    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:18.103944 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:18.103912    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:19.617020 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.616986    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"]
Nov 01 04:16:19.621190 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.621154    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.676474 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.676443    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"]
Nov 01 04:16:19.695362 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.695319    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.695706 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.695424    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.695706 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.695549    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjc9r\" (UniqueName: \"kubernetes.io/projected/5de9edb2-43c4-4215-a436-e7d98eb2815f-kube-api-access-jjc9r\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.695706 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.695568    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de9edb2-43c4-4215-a436-e7d98eb2815f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.797429 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.797389    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjc9r\" (UniqueName: \"kubernetes.io/projected/5de9edb2-43c4-4215-a436-e7d98eb2815f-kube-api-access-jjc9r\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.797647 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.797436    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de9edb2-43c4-4215-a436-e7d98eb2815f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.797647 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.797568    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.797647 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.797615    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.798304 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.798270    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de9edb2-43c4-4215-a436-e7d98eb2815f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.800274 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.800245    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.800589 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.800566    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.860454 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.860420    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjc9r\" (UniqueName: \"kubernetes.io/projected/5de9edb2-43c4-4215-a436-e7d98eb2815f-kube-api-access-jjc9r\") pod \"maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:19.937683 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:19.937651    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:20.025784 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:20.025738    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:20.327153 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:20.327122    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"]
Nov 01 04:16:20.329228 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:16:20.329199    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de9edb2_43c4_4215_a436_e7d98eb2815f.slice/crio-f78bb2f5223b6e3501479c11e4d1125eb7278983dc80e317015955f3f2c5b139 WatchSource:0}: Error finding container f78bb2f5223b6e3501479c11e4d1125eb7278983dc80e317015955f3f2c5b139: Status 404 returned error can't find the container with id f78bb2f5223b6e3501479c11e4d1125eb7278983dc80e317015955f3f2c5b139
Nov 01 04:16:20.913348 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:20.913307    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42" event={"ID":"5de9edb2-43c4-4215-a436-e7d98eb2815f","Type":"ContainerStarted","Data":"f78bb2f5223b6e3501479c11e4d1125eb7278983dc80e317015955f3f2c5b139"}
Nov 01 04:16:21.925043 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:21.925006    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42" event={"ID":"5de9edb2-43c4-4215-a436-e7d98eb2815f","Type":"ContainerStarted","Data":"b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534"}
Nov 01 04:16:21.925551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:21.925342    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:22.043686 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:22.043623    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42" podStartSLOduration=2.097196646 podStartE2EDuration="3.043605047s" totalImagesPullingTime="946.408401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:16:22.043438485 +0000 UTC m=+2002.803166281" watchObservedRunningTime="2026-11-01 04:16:22.043605047 +0000 UTC m=+2002.803332844"
Nov 01 04:16:22.428415 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:22.428379    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:24.052591 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:24.052503    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:25.224863 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:25.224827    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:26.813872 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:26.813837    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:26.881694 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:26.881666    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:16:26.881861 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:26.881738    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:16:27.012916 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:27.012875    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:27.941879 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:27.941846    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:16:28.115216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.115182    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"]
Nov 01 04:16:28.115445 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.115419    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj" podUID="445c6383-28c5-4555-9f3c-5288722858b3" containerName="maas-api" containerID="cri-o://9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d" gracePeriod=30
Nov 01 04:16:28.394884 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.394852    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:16:28.414509 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.414482    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/445c6383-28c5-4555-9f3c-5288722858b3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445c6383-28c5-4555-9f3c-5288722858b3-openshift-service-ca\") pod \"445c6383-28c5-4555-9f3c-5288722858b3\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") "
Nov 01 04:16:28.414672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.414524    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-metrics-certs\") pod \"445c6383-28c5-4555-9f3c-5288722858b3\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") "
Nov 01 04:16:28.414672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.414574    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/445c6383-28c5-4555-9f3c-5288722858b3-kube-api-access-s5p9h\" (UniqueName: \"kubernetes.io/projected/445c6383-28c5-4555-9f3c-5288722858b3-kube-api-access-s5p9h\") pod \"445c6383-28c5-4555-9f3c-5288722858b3\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") "
Nov 01 04:16:28.414672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.414643    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-maas-api-tls\") pod \"445c6383-28c5-4555-9f3c-5288722858b3\" (UID: \"445c6383-28c5-4555-9f3c-5288722858b3\") "
Nov 01 04:16:28.414892 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.414817    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/445c6383-28c5-4555-9f3c-5288722858b3-openshift-service-ca" pod "445c6383-28c5-4555-9f3c-5288722858b3" (UID: "445c6383-28c5-4555-9f3c-5288722858b3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:16:28.415061 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.415038    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/445c6383-28c5-4555-9f3c-5288722858b3-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:16:28.416610 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.416586    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-maas-api-tls" pod "445c6383-28c5-4555-9f3c-5288722858b3" (UID: "445c6383-28c5-4555-9f3c-5288722858b3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:16:28.416729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.416713    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445c6383-28c5-4555-9f3c-5288722858b3-kube-api-access-s5p9h" pod "445c6383-28c5-4555-9f3c-5288722858b3" (UID: "445c6383-28c5-4555-9f3c-5288722858b3"). InnerVolumeSpecName "kube-api-access-s5p9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:16:28.416803 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.416789    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-metrics-certs" pod "445c6383-28c5-4555-9f3c-5288722858b3" (UID: "445c6383-28c5-4555-9f3c-5288722858b3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:16:28.515849 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.515723    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:16:28.515849 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.515770    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5p9h\" (UniqueName: \"kubernetes.io/projected/445c6383-28c5-4555-9f3c-5288722858b3-kube-api-access-s5p9h\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:16:28.515849 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:28.515784    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/445c6383-28c5-4555-9f3c-5288722858b3-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:16:29.002897 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.002859    5529 generic.go:356] "Generic (PLEG): container finished" podID="445c6383-28c5-4555-9f3c-5288722858b3" containerID="9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d" exitCode=0
Nov 01 04:16:29.003458 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.002918    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"
Nov 01 04:16:29.003458 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.002947    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj" event={"ID":"445c6383-28c5-4555-9f3c-5288722858b3","Type":"ContainerDied","Data":"9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d"}
Nov 01 04:16:29.003458 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.003035    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj" event={"ID":"445c6383-28c5-4555-9f3c-5288722858b3","Type":"ContainerDied","Data":"fa726d763a86a65e4eabaed0e35377b1be77ee8811872066faf4c1a6bf82d63f"}
Nov 01 04:16:29.003458 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.003060    5529 scope.go:122] "RemoveContainer" containerID="9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d"
Nov 01 04:16:29.014294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.014268    5529 scope.go:122] "RemoveContainer" containerID="9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d"
Nov 01 04:16:29.014580 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:16:29.014553    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d\": container with ID starting with 9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d not found: ID does not exist" containerID="9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d"
Nov 01 04:16:29.014650 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.014591    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d"} err="failed to get container status \"9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d\": rpc error: code = NotFound desc = could not find container \"9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d\": container with ID starting with 9482e4b7f77045cac5c0520ea8ec54dbd9a9f66b293a5046b967502a3ff6366d not found: ID does not exist"
Nov 01 04:16:29.169015 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.168981    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"]
Nov 01 04:16:29.175602 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.175577    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-7dc645b88d-dnxdj"]
Nov 01 04:16:29.373640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:29.373609    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="445c6383-28c5-4555-9f3c-5288722858b3" path="/var/lib/kubelet/pods/445c6383-28c5-4555-9f3c-5288722858b3/volumes"
Nov 01 04:16:30.615383 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:30.615350    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:35.726340 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:35.726278    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:40.101599 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:40.101561    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:40.622724 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:40.622691    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:40.820218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:40.820185    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:41.711635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:41.711603    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:41.999010 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:41.998906    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:42.202953 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:42.202878    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:42.665826 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:42.665791    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:44.284651 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:16:44.284611    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:16:46.616735 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:46.616703    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:47.140539 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:47.140495    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:47.341391 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:47.341287    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:48.231229 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:48.231190    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:48.430175 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:48.430129    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:48.636805 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:48.636761    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:48.828899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:48.828866    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:49.112260 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:49.112183    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:49.306874 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:49.306842    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:49.517427 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:49.517345    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:54.311153 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:54.311114    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:55.470018 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:55.469950    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:57.321430 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:57.321397    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:58.289895 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:58.289856    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:16:58.935542 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:16:58.935497    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:01.822460 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:01.822428    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:06.934432 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:06.934395    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:11.264710 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:11.264660    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:12.726738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:12.726708    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:12.922621 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:12.922587    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:13.139062 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:13.139026    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:13.337682 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:13.337648    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:13.817791 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:13.817753    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:14.290951 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:17:14.290908    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:17:14.993147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:14.993111    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:15.728574 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:15.728541    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:15.924724 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:15.924682    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:18.595667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:18.595631    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:19.876994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:19.876266    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:20.174492 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:20.174362    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:20.198187 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:20.198143    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"]
Nov 01 04:17:20.198388 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:20.198365    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy" containerID="cri-o://2397cd24f96c94853aead947ad28c114886ef3ee7de659571e893615c3119908" gracePeriod=30
Nov 01 04:17:20.378386 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:20.378353    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:21.833941 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:21.833898    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:22.423950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:22.423907    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:22.700767 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:22.700682    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:22.899184 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:22.899141    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:23.368674 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:23.368643    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:25.305044 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.305010    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:25.466669 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.466633    5529 generic.go:356] "Generic (PLEG): container finished" podID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerID="2397cd24f96c94853aead947ad28c114886ef3ee7de659571e893615c3119908" exitCode=0
Nov 01 04:17:25.466945 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.466872    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" event={"ID":"bd637ff4-9c68-40f4-9efa-654bedbf4206","Type":"ContainerDied","Data":"2397cd24f96c94853aead947ad28c114886ef3ee7de659571e893615c3119908"}
Nov 01 04:17:25.466945 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.466934    5529 scope.go:122] "RemoveContainer" containerID="7492f082d5476ae0220930e064be814bcf5c679eb5ced896e2ef991f628e7d90"
Nov 01 04:17:25.496454 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.496427    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:17:25.503506 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.503479    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:25.550493 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550453    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-podinfo\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.550687 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550521    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-credential-socket\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.550687 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550612    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-certs\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.550806 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550725    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-token\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-token\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.550806 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550782    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd637ff4-9c68-40f4-9efa-654bedbf4206-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd637ff4-9c68-40f4-9efa-654bedbf4206-istiod-ca-cert\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.550920 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550832    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-envoy\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.550920 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550863    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-kube-api-access-675kv\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-kube-api-access-675kv\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.551028 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550922    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-data\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.551028 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550950    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-socket\") pod \"bd637ff4-9c68-40f4-9efa-654bedbf4206\" (UID: \"bd637ff4-9c68-40f4-9efa-654bedbf4206\") "
Nov 01 04:17:25.551127 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550858    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-credential-socket" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:25.551127 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.550874    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-certs" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:25.551272 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.551227    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd637ff4-9c68-40f4-9efa-654bedbf4206-istiod-ca-cert" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:17:25.551355 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.551330    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-data" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:25.551460 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.551440    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-socket" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:25.551616 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.551578    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd637ff4-9c68-40f4-9efa-654bedbf4206-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.551616 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.551608    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.551812 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.551626    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.551812 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.551640    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.553565 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.553530    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-envoy" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:25.553565 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.553558    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-kube-api-access-675kv" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "kube-api-access-675kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:17:25.553809 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.553790    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-podinfo" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:17:25.553994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.553976    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-token" pod "bd637ff4-9c68-40f4-9efa-654bedbf4206" (UID: "bd637ff4-9c68-40f4-9efa-654bedbf4206"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:17:25.657192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.653976    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.657192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.654014    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.657192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.654028    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-675kv\" (UniqueName: \"kubernetes.io/projected/bd637ff4-9c68-40f4-9efa-654bedbf4206-kube-api-access-675kv\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.657192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.654041    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd637ff4-9c68-40f4-9efa-654bedbf4206-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.657192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.654057    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd637ff4-9c68-40f4-9efa-654bedbf4206-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:25.708659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.708624    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:25.918142 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:25.918105    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:26.261652 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:26.261571    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:26.474474 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:26.474435    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"
Nov 01 04:17:26.474474 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:26.474444    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l" event={"ID":"bd637ff4-9c68-40f4-9efa-654bedbf4206","Type":"ContainerDied","Data":"423cd6fd32d7c369bbe21355def700eb7c5426fffec23ee453cfb1f2756433c4"}
Nov 01 04:17:26.475028 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:26.474501    5529 scope.go:122] "RemoveContainer" containerID="2397cd24f96c94853aead947ad28c114886ef3ee7de659571e893615c3119908"
Nov 01 04:17:26.759278 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:26.759237    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"]
Nov 01 04:17:26.765400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:26.765374    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-535e84-openshift-default-d99999c69-wh25l"]
Nov 01 04:17:27.374814 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:27.374781    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" path="/var/lib/kubelet/pods/bd637ff4-9c68-40f4-9efa-654bedbf4206/volumes"
Nov 01 04:17:28.143890 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:28.143837    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:28.370125 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:28.370095    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:28.572897 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:28.572796    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:30.849603 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:30.849560    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:31.411375 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:31.411333    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:31.608986 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:31.608950    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:33.279709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:33.279674    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:33.482454 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:33.482418    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:33.633763 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:33.633726    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"]
Nov 01 04:17:33.633952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:33.633927    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy" containerID="cri-o://adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4" gracePeriod=30
Nov 01 04:17:33.753816 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:33.753225    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:33.985205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:33.985104    5529 patch_prober.go:29] interesting pod/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 01 04:17:33.985205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:33.985185    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 01 04:17:35.254499 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:35.254469    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:35.873792 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:35.873742    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:36.072544 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:36.072507    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:36.274390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:36.274307    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:38.911225 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:38.911120    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:17:39.027231 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027194    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-certs\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027446 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027275    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-kube-api-access-jgvb7\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-kube-api-access-jgvb7\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027446 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027338    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7fcb708-5355-4d46-9c90-f7c596e8542a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7fcb708-5355-4d46-9c90-f7c596e8542a-istiod-ca-cert\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027446 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027394    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-envoy\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027442    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-certs" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:39.027624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027466    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-podinfo\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027524    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-data\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027596    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-socket\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027847 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027634    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-token\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-token\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027847 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027658    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-credential-socket\") pod \"c7fcb708-5355-4d46-9c90-f7c596e8542a\" (UID: \"c7fcb708-5355-4d46-9c90-f7c596e8542a\") "
Nov 01 04:17:39.027847 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027768    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-data" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:39.027847 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.027815    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fcb708-5355-4d46-9c90-f7c596e8542a-istiod-ca-cert" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:17:39.028270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.028238    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-socket" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:39.028270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.028255    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.028452 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.028280    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7fcb708-5355-4d46-9c90-f7c596e8542a-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.028452 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.028296    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.028452 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.028312    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-credential-socket" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:39.029972 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.029897    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-kube-api-access-jgvb7" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "kube-api-access-jgvb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:17:39.030081 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.030013    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-envoy" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:17:39.030195 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.030155    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-token" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:17:39.030640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.030611    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-podinfo" pod "c7fcb708-5355-4d46-9c90-f7c596e8542a" (UID: "c7fcb708-5355-4d46-9c90-f7c596e8542a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:17:39.129746 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.129714    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgvb7\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-kube-api-access-jgvb7\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.129746 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.129744    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.129746 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.129755    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.129994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.129764    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.129994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.129774    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7fcb708-5355-4d46-9c90-f7c596e8542a-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.129994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.129783    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7fcb708-5355-4d46-9c90-f7c596e8542a-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:17:39.610870 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.610835    5529 generic.go:356] "Generic (PLEG): container finished" podID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerID="adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4" exitCode=0
Nov 01 04:17:39.611059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.610898    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"
Nov 01 04:17:39.611059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.610919    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" event={"ID":"c7fcb708-5355-4d46-9c90-f7c596e8542a","Type":"ContainerDied","Data":"adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4"}
Nov 01 04:17:39.611059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.610982    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z" event={"ID":"c7fcb708-5355-4d46-9c90-f7c596e8542a","Type":"ContainerDied","Data":"598f71fff363957417cd7cb763ba78b178618946c7fe8b66f1778f0936103c79"}
Nov 01 04:17:39.611059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.611005    5529 scope.go:122] "RemoveContainer" containerID="adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4"
Nov 01 04:17:39.621403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.621382    5529 scope.go:122] "RemoveContainer" containerID="4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df"
Nov 01 04:17:39.633584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.632933    5529 scope.go:122] "RemoveContainer" containerID="adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4"
Nov 01 04:17:39.633993 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:17:39.633959    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4\": container with ID starting with adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4 not found: ID does not exist" containerID="adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4"
Nov 01 04:17:39.634111 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.634003    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4"} err="failed to get container status \"adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4\": rpc error: code = NotFound desc = could not find container \"adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4\": container with ID starting with adc8e5bc899515e13d7be6b011342a47959fb73557396272be4c7d9e69b306a4 not found: ID does not exist"
Nov 01 04:17:39.634111 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.634027    5529 scope.go:122] "RemoveContainer" containerID="4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df"
Nov 01 04:17:39.634417 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:17:39.634397    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df\": container with ID starting with 4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df not found: ID does not exist" containerID="4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df"
Nov 01 04:17:39.634486 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.634422    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df"} err="failed to get container status \"4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df\": rpc error: code = NotFound desc = could not find container \"4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df\": container with ID starting with 4f934d2b928fc88000fc447fc5de7697e1a7a76be904ca10127e68dfb9a910df not found: ID does not exist"
Nov 01 04:17:39.828238 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.828201    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"]
Nov 01 04:17:39.834983 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:39.834952    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-2d683e-openshift-default-59466dfd5c-4d48z"]
Nov 01 04:17:40.354212 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:40.354150    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:40.556096 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:40.556064    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:41.152969 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:41.152924    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:41.373753 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:41.373719    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" path="/var/lib/kubelet/pods/c7fcb708-5355-4d46-9c90-f7c596e8542a/volumes"
Nov 01 04:17:43.520514 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:43.520480    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:43.713299 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:43.713264    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:44.286008 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:17:44.285962    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:17:45.169982 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:45.169937    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:45.369041 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:45.369009    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:46.557635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:46.557601    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:51.507841 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:51.507809    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:56.707842 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:56.707812    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:17:59.699554 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:59.699529    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:17:59.708666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:17:59.708645    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:18:01.191323 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:01.191249    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"]
Nov 01 04:18:01.400018 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:01.399974    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:01.599414 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:01.599305    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:03.605960 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:03.605924    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:06.192494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.192450    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5" podUID="b5354296-d342-458b-bbf3-6372f3b36959" containerName="payload-pre-processing" containerID="cri-o://7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df" gracePeriod=25
Nov 01 04:18:06.483516 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.483490    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:18:06.535527 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.535497    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b5354296-d342-458b-bbf3-6372f3b36959-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5354296-d342-458b-bbf3-6372f3b36959-plugins-config-volume\") pod \"b5354296-d342-458b-bbf3-6372f3b36959\" (UID: \"b5354296-d342-458b-bbf3-6372f3b36959\") "
Nov 01 04:18:06.535734 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.535533    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5354296-d342-458b-bbf3-6372f3b36959-kube-api-access-4gg84\" (UniqueName: \"kubernetes.io/projected/b5354296-d342-458b-bbf3-6372f3b36959-kube-api-access-4gg84\") pod \"b5354296-d342-458b-bbf3-6372f3b36959\" (UID: \"b5354296-d342-458b-bbf3-6372f3b36959\") "
Nov 01 04:18:06.536010 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.535971    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5354296-d342-458b-bbf3-6372f3b36959-plugins-config-volume" pod "b5354296-d342-458b-bbf3-6372f3b36959" (UID: "b5354296-d342-458b-bbf3-6372f3b36959"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:18:06.536213 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.536191    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5354296-d342-458b-bbf3-6372f3b36959-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:18:06.537976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.537952    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5354296-d342-458b-bbf3-6372f3b36959-kube-api-access-4gg84" pod "b5354296-d342-458b-bbf3-6372f3b36959" (UID: "b5354296-d342-458b-bbf3-6372f3b36959"). InnerVolumeSpecName "kube-api-access-4gg84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:18:06.637427 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.637382    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gg84\" (UniqueName: \"kubernetes.io/projected/b5354296-d342-458b-bbf3-6372f3b36959-kube-api-access-4gg84\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:18:06.799700 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.799614    5529 generic.go:356] "Generic (PLEG): container finished" podID="b5354296-d342-458b-bbf3-6372f3b36959" containerID="7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df" exitCode=0
Nov 01 04:18:06.799700 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.799662    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"
Nov 01 04:18:06.799700 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.799690    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5" event={"ID":"b5354296-d342-458b-bbf3-6372f3b36959","Type":"ContainerDied","Data":"7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df"}
Nov 01 04:18:06.799972 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.799758    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5" event={"ID":"b5354296-d342-458b-bbf3-6372f3b36959","Type":"ContainerDied","Data":"c38609d845785dd75030ae863da67c2bc35f335c6822ee574982bc899aa5e0f4"}
Nov 01 04:18:06.799972 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.799779    5529 scope.go:122] "RemoveContainer" containerID="7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df"
Nov 01 04:18:06.810336 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.810320    5529 scope.go:122] "RemoveContainer" containerID="7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df"
Nov 01 04:18:06.810670 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:18:06.810651    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df\": container with ID starting with 7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df not found: ID does not exist" containerID="7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df"
Nov 01 04:18:06.810735 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.810678    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df"} err="failed to get container status \"7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df\": rpc error: code = NotFound desc = could not find container \"7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df\": container with ID starting with 7cda0130ca882c66590973ae19ae4052ad724bbd00c3175e926148beaf49e8df not found: ID does not exist"
Nov 01 04:18:06.966985 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.966948    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"]
Nov 01 04:18:06.971074 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:06.971048    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-3a348f-697c5dc547-764x5"]
Nov 01 04:18:07.374117 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:07.374084    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5354296-d342-458b-bbf3-6372f3b36959" path="/var/lib/kubelet/pods/b5354296-d342-458b-bbf3-6372f3b36959/volumes"
Nov 01 04:18:08.613346 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:08.613310    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:13.093341 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:13.093309    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:13.608899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:13.608865    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:14.285387 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:18:14.285353    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:18:18.445222 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:18.445186    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:18.648392 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:18.648352    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:23.214436 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:23.214382    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:23.412183 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:23.412141    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:23.948600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:23.948558    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:24.164487 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:24.164440    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:24.730529 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:24.730492    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:25.046039 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:25.045957    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:26.582470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:26.582422    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"]
Nov 01 04:18:26.712637 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:26.712607    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"]
Nov 01 04:18:26.987146 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:26.987115    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:27.194098 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:27.194065    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:29.042022 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.041990    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"]
Nov 01 04:18:29.042575 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042558    5529 cpu_manager.go:414] "containerMap: removing container" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy"
Nov 01 04:18:29.042575 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042576    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy"
Nov 01 04:18:29.042672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042595    5529 cpu_manager.go:414] "containerMap: removing container" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy"
Nov 01 04:18:29.042672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042600    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy"
Nov 01 04:18:29.042672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042607    5529 cpu_manager.go:414] "containerMap: removing container" podUID="445c6383-28c5-4555-9f3c-5288722858b3" containerName="maas-api"
Nov 01 04:18:29.042672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042612    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="445c6383-28c5-4555-9f3c-5288722858b3" containerName="maas-api"
Nov 01 04:18:29.042672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042638    5529 cpu_manager.go:414] "containerMap: removing container" podUID="b5354296-d342-458b-bbf3-6372f3b36959" containerName="payload-pre-processing"
Nov 01 04:18:29.042672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042643    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5354296-d342-458b-bbf3-6372f3b36959" containerName="payload-pre-processing"
Nov 01 04:18:29.042672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042657    5529 cpu_manager.go:414] "containerMap: removing container" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy"
Nov 01 04:18:29.042672 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042661    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy"
Nov 01 04:18:29.042918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042743    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5354296-d342-458b-bbf3-6372f3b36959" containerName="payload-pre-processing"
Nov 01 04:18:29.042918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042754    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy"
Nov 01 04:18:29.042918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042761    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy"
Nov 01 04:18:29.042918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042769    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy"
Nov 01 04:18:29.042918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.042777    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="445c6383-28c5-4555-9f3c-5288722858b3" containerName="maas-api"
Nov 01 04:18:29.046254 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.046232    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.099052 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.099013    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-a-4c2a66-serving-cert\""
Nov 01 04:18:29.100801 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.100773    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"]
Nov 01 04:18:29.114601 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.114569    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.114802 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.114630    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9425546-ab4d-4088-9b74-4f744cbbd8ca-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.114802 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.114724    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j57xv\" (UniqueName: \"kubernetes.io/projected/c9425546-ab4d-4088-9b74-4f744cbbd8ca-kube-api-access-j57xv\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.114918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.114872    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-metrics-certs\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.215768 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.215731    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.215950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.215790    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9425546-ab4d-4088-9b74-4f744cbbd8ca-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.215950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.215822    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j57xv\" (UniqueName: \"kubernetes.io/projected/c9425546-ab4d-4088-9b74-4f744cbbd8ca-kube-api-access-j57xv\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.215950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.215872    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-metrics-certs\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.215950 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:18:29.215882    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-serving-cert: secret "maas-api-e2e-praxis-a-4c2a66-serving-cert" not found
Nov 01 04:18:29.215950 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:18:29.215941    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls podName:c9425546-ab4d-4088-9b74-4f744cbbd8ca nodeName:}" failed. No retries permitted until 2026-11-01 04:18:29.715926381 +0000 UTC m=+2130.475654157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls") pod "maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm" (UID: "c9425546-ab4d-4088-9b74-4f744cbbd8ca") : secret "maas-api-e2e-praxis-a-4c2a66-serving-cert" not found
Nov 01 04:18:29.216569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.216548    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9425546-ab4d-4088-9b74-4f744cbbd8ca-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.218472 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.218447    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-metrics-certs\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.278001 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.277968    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j57xv\" (UniqueName: \"kubernetes.io/projected/c9425546-ab4d-4088-9b74-4f744cbbd8ca-kube-api-access-j57xv\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.351116 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.350985    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:29.548998 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.548968    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:29.722889 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.722849    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.725354 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.725328    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls\") pod \"maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:29.738371 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.738342    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:29.960106 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:29.960064    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:30.343598 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:30.343541    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"]
Nov 01 04:18:30.349525 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:18:30.349489    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9425546_ab4d_4088_9b74_4f744cbbd8ca.slice/crio-325c25bab97a58d830839f621fd95bb06c5c94ef6f3e6cdb2a94990c392f61d6 WatchSource:0}: Error finding container 325c25bab97a58d830839f621fd95bb06c5c94ef6f3e6cdb2a94990c392f61d6: Status 404 returned error can't find the container with id 325c25bab97a58d830839f621fd95bb06c5c94ef6f3e6cdb2a94990c392f61d6
Nov 01 04:18:30.609118 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:30.609038    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:30.815553 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:30.815522    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:30.978773 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:30.978735    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm" event={"ID":"c9425546-ab4d-4088-9b74-4f744cbbd8ca","Type":"ContainerStarted","Data":"325c25bab97a58d830839f621fd95bb06c5c94ef6f3e6cdb2a94990c392f61d6"}
Nov 01 04:18:31.586520 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.583214    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44" podUID="dcaeecbf-2334-4389-8055-42efe9618e02" containerName="payload-processing" containerID="cri-o://755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961" gracePeriod=25
Nov 01 04:18:31.713225 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.713158    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz" podUID="448d4f5b-0dd0-4a88-97ba-669c487fd84e" containerName="payload-pre-processing" containerID="cri-o://53a8a7824bcdb6889d23229e6cf8e695d05cf5018e6456af26e59d63868ab363" gracePeriod=25
Nov 01 04:18:31.879494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.879465    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:18:31.947118 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.947087    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dcaeecbf-2334-4389-8055-42efe9618e02-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcaeecbf-2334-4389-8055-42efe9618e02-plugins-config-volume\") pod \"dcaeecbf-2334-4389-8055-42efe9618e02\" (UID: \"dcaeecbf-2334-4389-8055-42efe9618e02\") "
Nov 01 04:18:31.960105 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.947336    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dcaeecbf-2334-4389-8055-42efe9618e02-kube-api-access-t7jpj\" (UniqueName: \"kubernetes.io/projected/dcaeecbf-2334-4389-8055-42efe9618e02-kube-api-access-t7jpj\") pod \"dcaeecbf-2334-4389-8055-42efe9618e02\" (UID: \"dcaeecbf-2334-4389-8055-42efe9618e02\") "
Nov 01 04:18:31.960105 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.947531    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcaeecbf-2334-4389-8055-42efe9618e02-plugins-config-volume" pod "dcaeecbf-2334-4389-8055-42efe9618e02" (UID: "dcaeecbf-2334-4389-8055-42efe9618e02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:18:31.960105 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.947743    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dcaeecbf-2334-4389-8055-42efe9618e02-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:18:31.960481 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.960446    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcaeecbf-2334-4389-8055-42efe9618e02-kube-api-access-t7jpj" pod "dcaeecbf-2334-4389-8055-42efe9618e02" (UID: "dcaeecbf-2334-4389-8055-42efe9618e02"). InnerVolumeSpecName "kube-api-access-t7jpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:18:31.988051 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.988022    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm" event={"ID":"c9425546-ab4d-4088-9b74-4f744cbbd8ca","Type":"ContainerStarted","Data":"6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766"}
Nov 01 04:18:31.988210 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.988093    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:31.989590 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.989570    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:18:31.989701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.989608    5529 generic.go:356] "Generic (PLEG): container finished" podID="dcaeecbf-2334-4389-8055-42efe9618e02" containerID="755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961" exitCode=0
Nov 01 04:18:31.989701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.989644    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"
Nov 01 04:18:31.989701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.989684    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44" event={"ID":"dcaeecbf-2334-4389-8055-42efe9618e02","Type":"ContainerDied","Data":"755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961"}
Nov 01 04:18:31.989852 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.989735    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44" event={"ID":"dcaeecbf-2334-4389-8055-42efe9618e02","Type":"ContainerDied","Data":"4676a9727b9719a5112a075018b0063d2476087c46d294020d253f65019b0297"}
Nov 01 04:18:31.989852 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.989760    5529 scope.go:122] "RemoveContainer" containerID="755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961"
Nov 01 04:18:31.991205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.991142    5529 generic.go:356] "Generic (PLEG): container finished" podID="448d4f5b-0dd0-4a88-97ba-669c487fd84e" containerID="53a8a7824bcdb6889d23229e6cf8e695d05cf5018e6456af26e59d63868ab363" exitCode=0
Nov 01 04:18:31.991205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.991195    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"
Nov 01 04:18:31.991205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:31.991197    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz" event={"ID":"448d4f5b-0dd0-4a88-97ba-669c487fd84e","Type":"ContainerDied","Data":"53a8a7824bcdb6889d23229e6cf8e695d05cf5018e6456af26e59d63868ab363"}
Nov 01 04:18:32.006307 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.006283    5529 scope.go:122] "RemoveContainer" containerID="755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961"
Nov 01 04:18:32.006767 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:18:32.006737    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961\": container with ID starting with 755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961 not found: ID does not exist" containerID="755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961"
Nov 01 04:18:32.006931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.006896    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961"} err="failed to get container status \"755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961\": rpc error: code = NotFound desc = could not find container \"755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961\": container with ID starting with 755f64a59bbb21f8cb76d2363a59f417cb966d5c9644b90f2ee0220608993961 not found: ID does not exist"
Nov 01 04:18:32.006931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.006932    5529 scope.go:122] "RemoveContainer" containerID="53a8a7824bcdb6889d23229e6cf8e695d05cf5018e6456af26e59d63868ab363"
Nov 01 04:18:32.048401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.048367    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/448d4f5b-0dd0-4a88-97ba-669c487fd84e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/448d4f5b-0dd0-4a88-97ba-669c487fd84e-plugins-config-volume\") pod \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\" (UID: \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\") "
Nov 01 04:18:32.048624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.048501    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/448d4f5b-0dd0-4a88-97ba-669c487fd84e-kube-api-access-jxg9s\" (UniqueName: \"kubernetes.io/projected/448d4f5b-0dd0-4a88-97ba-669c487fd84e-kube-api-access-jxg9s\") pod \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\" (UID: \"448d4f5b-0dd0-4a88-97ba-669c487fd84e\") "
Nov 01 04:18:32.048804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.048778    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/448d4f5b-0dd0-4a88-97ba-669c487fd84e-plugins-config-volume" pod "448d4f5b-0dd0-4a88-97ba-669c487fd84e" (UID: "448d4f5b-0dd0-4a88-97ba-669c487fd84e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:18:32.049065 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.049041    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7jpj\" (UniqueName: \"kubernetes.io/projected/dcaeecbf-2334-4389-8055-42efe9618e02-kube-api-access-t7jpj\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:18:32.049065 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.049067    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/448d4f5b-0dd0-4a88-97ba-669c487fd84e-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:18:32.050925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.050901    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/448d4f5b-0dd0-4a88-97ba-669c487fd84e-kube-api-access-jxg9s" pod "448d4f5b-0dd0-4a88-97ba-669c487fd84e" (UID: "448d4f5b-0dd0-4a88-97ba-669c487fd84e"). InnerVolumeSpecName "kube-api-access-jxg9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:18:32.150911 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.150867    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxg9s\" (UniqueName: \"kubernetes.io/projected/448d4f5b-0dd0-4a88-97ba-669c487fd84e-kube-api-access-jxg9s\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:18:32.287850 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.287790    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm" podStartSLOduration=3.403701645 podStartE2EDuration="4.28777525s" totalImagesPullingTime="884.073605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:18:32.285291792 +0000 UTC m=+2133.045019584" watchObservedRunningTime="2026-11-01 04:18:32.28777525 +0000 UTC m=+2133.047503045"
Nov 01 04:18:32.400513 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.400471    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"]
Nov 01 04:18:32.410374 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.410292    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-601a4b-795cd4d4bf-8hr44"]
Nov 01 04:18:32.515245 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.515212    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"]
Nov 01 04:18:32.520847 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:32.520814    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-601a4b-89b8c5779-cj7jz"]
Nov 01 04:18:33.374882 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:33.374845    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="448d4f5b-0dd0-4a88-97ba-669c487fd84e" path="/var/lib/kubelet/pods/448d4f5b-0dd0-4a88-97ba-669c487fd84e/volumes"
Nov 01 04:18:33.375375 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:33.375271    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dcaeecbf-2334-4389-8055-42efe9618e02" path="/var/lib/kubelet/pods/dcaeecbf-2334-4389-8055-42efe9618e02/volumes"
Nov 01 04:18:34.738350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:34.738315    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:34.936686 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:34.936644    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:35.089356 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089255    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"]
Nov 01 04:18:35.089790 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089776    5529 cpu_manager.go:414] "containerMap: removing container" podUID="448d4f5b-0dd0-4a88-97ba-669c487fd84e" containerName="payload-pre-processing"
Nov 01 04:18:35.089867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089790    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="448d4f5b-0dd0-4a88-97ba-669c487fd84e" containerName="payload-pre-processing"
Nov 01 04:18:35.089867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089817    5529 cpu_manager.go:414] "containerMap: removing container" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy"
Nov 01 04:18:35.089867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089823    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7fcb708-5355-4d46-9c90-f7c596e8542a" containerName="istio-proxy"
Nov 01 04:18:35.089867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089839    5529 cpu_manager.go:414] "containerMap: removing container" podUID="dcaeecbf-2334-4389-8055-42efe9618e02" containerName="payload-processing"
Nov 01 04:18:35.089867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089844    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dcaeecbf-2334-4389-8055-42efe9618e02" containerName="payload-processing"
Nov 01 04:18:35.090119 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089929    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd637ff4-9c68-40f4-9efa-654bedbf4206" containerName="istio-proxy"
Nov 01 04:18:35.090119 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089940    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="dcaeecbf-2334-4389-8055-42efe9618e02" containerName="payload-processing"
Nov 01 04:18:35.090119 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.089952    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="448d4f5b-0dd0-4a88-97ba-669c487fd84e" containerName="payload-pre-processing"
Nov 01 04:18:35.095012 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.094989    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:35.136214 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.136181    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:35.147561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.147526    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"]
Nov 01 04:18:35.199186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.187644    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x42qd\" (UniqueName: \"kubernetes.io/projected/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-kube-api-access-x42qd\") pod \"payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr\" (UID: \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:35.199186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.187788    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr\" (UID: \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:35.211238 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.199750    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0ee0f8\""
Nov 01 04:18:35.250065 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.250030    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0ee0f8-dockercfg-c9ckj\""
Nov 01 04:18:35.253266 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.253233    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"]
Nov 01 04:18:35.257449 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.257430    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:35.289100 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.289063    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr\" (UID: \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:35.289329 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.289262    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x42qd\" (UniqueName: \"kubernetes.io/projected/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-kube-api-access-x42qd\") pod \"payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr\" (UID: \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:35.289899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.289877    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr\" (UID: \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:35.306832 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.306796    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"]
Nov 01 04:18:35.350633 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.350560    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x42qd\" (UniqueName: \"kubernetes.io/projected/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-kube-api-access-x42qd\") pod \"payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr\" (UID: \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:35.391024 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.390985    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f7vx\" (UniqueName: \"kubernetes.io/projected/962b62e4-012a-428f-817f-8e23bb401747-kube-api-access-9f7vx\") pod \"payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9\" (UID: \"962b62e4-012a-428f-817f-8e23bb401747\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:35.391372 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.391313    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962b62e4-012a-428f-817f-8e23bb401747-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9\" (UID: \"962b62e4-012a-428f-817f-8e23bb401747\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:35.409806 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.409767    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:35.493004 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.492964    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962b62e4-012a-428f-817f-8e23bb401747-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9\" (UID: \"962b62e4-012a-428f-817f-8e23bb401747\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:35.493294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.493269    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7vx\" (UniqueName: \"kubernetes.io/projected/962b62e4-012a-428f-817f-8e23bb401747-kube-api-access-9f7vx\") pod \"payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9\" (UID: \"962b62e4-012a-428f-817f-8e23bb401747\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:35.493902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.493876    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962b62e4-012a-428f-817f-8e23bb401747-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9\" (UID: \"962b62e4-012a-428f-817f-8e23bb401747\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:35.554749 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.554713    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7vx\" (UniqueName: \"kubernetes.io/projected/962b62e4-012a-428f-817f-8e23bb401747-kube-api-access-9f7vx\") pod \"payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9\" (UID: \"962b62e4-012a-428f-817f-8e23bb401747\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:35.573141 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.573115    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:35.791086 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.791057    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"]
Nov 01 04:18:35.791607 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:18:35.791580    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c7daf5_033c_4d12_81ac_1ae555cc6fa1.slice/crio-0f3f52fe6b950968c330954f616f8a5191c011cc87a536a87453f2d47dbbcdae WatchSource:0}: Error finding container 0f3f52fe6b950968c330954f616f8a5191c011cc87a536a87453f2d47dbbcdae: Status 404 returned error can't find the container with id 0f3f52fe6b950968c330954f616f8a5191c011cc87a536a87453f2d47dbbcdae
Nov 01 04:18:35.953175 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:35.953144    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"]
Nov 01 04:18:35.955840 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:18:35.955814    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962b62e4_012a_428f_817f_8e23bb401747.slice/crio-e3a2f987e2396cdc1d8a0295eced8e6ee56454e9d4885a7a50532d2675791710 WatchSource:0}: Error finding container e3a2f987e2396cdc1d8a0295eced8e6ee56454e9d4885a7a50532d2675791710: Status 404 returned error can't find the container with id e3a2f987e2396cdc1d8a0295eced8e6ee56454e9d4885a7a50532d2675791710
Nov 01 04:18:36.021126 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:36.021092    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr" event={"ID":"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1","Type":"ContainerStarted","Data":"2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8"}
Nov 01 04:18:36.021293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:36.021154    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr" event={"ID":"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1","Type":"ContainerStarted","Data":"0f3f52fe6b950968c330954f616f8a5191c011cc87a536a87453f2d47dbbcdae"}
Nov 01 04:18:36.021293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:36.021199    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:36.022911 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:36.022886    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9" event={"ID":"962b62e4-012a-428f-817f-8e23bb401747","Type":"ContainerStarted","Data":"e3a2f987e2396cdc1d8a0295eced8e6ee56454e9d4885a7a50532d2675791710"}
Nov 01 04:18:36.137701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:36.137583    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr" podStartSLOduration=1.137569321 podStartE2EDuration="1.137569321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:18:36.137140296 +0000 UTC m=+2136.896868090" watchObservedRunningTime="2026-11-01 04:18:36.137569321 +0000 UTC m=+2136.897297116"
Nov 01 04:18:37.032416 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:37.032379    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9" event={"ID":"962b62e4-012a-428f-817f-8e23bb401747","Type":"ContainerStarted","Data":"32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55"}
Nov 01 04:18:37.032934 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:37.032471    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:37.150794 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:37.150733    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9" podStartSLOduration=2.150713915 podStartE2EDuration="2.150713915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:18:37.148758904 +0000 UTC m=+2137.908486699" watchObservedRunningTime="2026-11-01 04:18:37.150713915 +0000 UTC m=+2137.910441711"
Nov 01 04:18:38.005944 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:38.005917    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:18:40.020002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:40.019963    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:44.284813 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:18:44.284766    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:18:45.005829 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:45.005793    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:47.036098 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:47.036073    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:18:48.043379 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:48.043349    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:18:49.606680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.606640    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"]
Nov 01 04:18:49.610770 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.610748    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.665403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.665368    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"]
Nov 01 04:18:49.674325 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.674294    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m86wm\" (UniqueName: \"kubernetes.io/projected/3881b824-3057-400c-a35f-35a71dda6f43-kube-api-access-m86wm\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.674487 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.674362    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.674552 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.674526    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-metrics-certs\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.674617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.674586    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881b824-3057-400c-a35f-35a71dda6f43-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.712816 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.712787    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-a-e7c9be-serving-cert\""
Nov 01 04:18:49.775537 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.775496    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m86wm\" (UniqueName: \"kubernetes.io/projected/3881b824-3057-400c-a35f-35a71dda6f43-kube-api-access-m86wm\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.775731 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.775562    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.775731 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.775609    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-metrics-certs\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.775731 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:18:49.775699    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-serving-cert: secret "maas-api-e2e-praxis-a-e7c9be-serving-cert" not found
Nov 01 04:18:49.775902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.775743    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881b824-3057-400c-a35f-35a71dda6f43-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.775902 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:18:49.775756    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls podName:3881b824-3057-400c-a35f-35a71dda6f43 nodeName:}" failed. No retries permitted until 2026-11-01 04:18:50.275739492 +0000 UTC m=+2151.035467264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls") pod "maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q" (UID: "3881b824-3057-400c-a35f-35a71dda6f43") : secret "maas-api-e2e-praxis-a-e7c9be-serving-cert" not found
Nov 01 04:18:49.776511 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.776485    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881b824-3057-400c-a35f-35a71dda6f43-openshift-service-ca\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.778045 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.778025    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-metrics-certs\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:49.833811 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.833778    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:49.837554 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:49.837518    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m86wm\" (UniqueName: \"kubernetes.io/projected/3881b824-3057-400c-a35f-35a71dda6f43-kube-api-access-m86wm\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:50.037792 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:50.037754    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:50.239952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:50.239918    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:50.282670 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:50.282635    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:50.285232 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:50.285134    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls\") pod \"maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:50.525689 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:50.525654    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:50.907815 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:50.907793    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"]
Nov 01 04:18:50.910033 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:18:50.910003    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3881b824_3057_400c_a35f_35a71dda6f43.slice/crio-0597edee4b9a03575043cfc8e2172689edc3b5409eca1518a0e605c8fc46442d WatchSource:0}: Error finding container 0597edee4b9a03575043cfc8e2172689edc3b5409eca1518a0e605c8fc46442d: Status 404 returned error can't find the container with id 0597edee4b9a03575043cfc8e2172689edc3b5409eca1518a0e605c8fc46442d
Nov 01 04:18:51.130045 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:51.130007    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q" event={"ID":"3881b824-3057-400c-a35f-35a71dda6f43","Type":"ContainerStarted","Data":"0597edee4b9a03575043cfc8e2172689edc3b5409eca1518a0e605c8fc46442d"}
Nov 01 04:18:52.149114 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:52.149075    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q" event={"ID":"3881b824-3057-400c-a35f-35a71dda6f43","Type":"ContainerStarted","Data":"c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86"}
Nov 01 04:18:52.149601 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:52.149306    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:18:52.268730 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:52.268668    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q" podStartSLOduration=2.430418849 podStartE2EDuration="3.26865428s" totalImagesPullingTime="838.235431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:18:52.267030992 +0000 UTC m=+2153.026758784" watchObservedRunningTime="2026-11-01 04:18:52.26865428 +0000 UTC m=+2153.028382119"
Nov 01 04:18:55.116269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:55.116212    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:18:58.164386 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:18:58.164359    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:19:00.215306 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:00.215211    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:05.360551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:05.360508    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:09.049661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:09.049498    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:09.551214 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:09.551143    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:12.407832 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:12.407762    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:13.379840 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:13.379811    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:14.286491 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:19:14.286440    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:19:19.100227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:19.100187    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:23.494991 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:23.494941    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:24.027696 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:24.027656    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:29.184200 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:29.184149    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:30.048092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:30.048059    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:30.655488 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:30.655457    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:30.893063 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:30.893025    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:32.926729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:32.926688    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:33.450430 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:33.450393    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:34.816267 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:34.816227    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:35.018848 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:35.018820    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:36.408391 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:36.408348    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:37.999763 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:37.999718    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:38.194690 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.194656    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:38.352687 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.352612    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"]
Nov 01 04:19:38.357062 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.357038    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:38.410315 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.410276    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"]
Nov 01 04:19:38.457506 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.457454    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0882f4\""
Nov 01 04:19:38.457792 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.457776    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0882f4-dockercfg-f5w97\""
Nov 01 04:19:38.465484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.465448    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc28cc2c-c119-4f2d-8f4e-ea328585c311-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb\" (UID: \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:38.465758 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.465739    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vgfr\" (UniqueName: \"kubernetes.io/projected/dc28cc2c-c119-4f2d-8f4e-ea328585c311-kube-api-access-2vgfr\") pod \"payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb\" (UID: \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:38.511819 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.511782    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"]
Nov 01 04:19:38.515969 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.515947    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:38.566874 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.566840    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc28cc2c-c119-4f2d-8f4e-ea328585c311-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb\" (UID: \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:38.567072 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.566899    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vgfr\" (UniqueName: \"kubernetes.io/projected/dc28cc2c-c119-4f2d-8f4e-ea328585c311-kube-api-access-2vgfr\") pod \"payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb\" (UID: \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:38.567708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.567677    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc28cc2c-c119-4f2d-8f4e-ea328585c311-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb\" (UID: \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:38.570384 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.570357    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"]
Nov 01 04:19:38.629615 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.629575    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vgfr\" (UniqueName: \"kubernetes.io/projected/dc28cc2c-c119-4f2d-8f4e-ea328585c311-kube-api-access-2vgfr\") pod \"payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb\" (UID: \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:38.668318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.668287    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv6tp\" (UniqueName: \"kubernetes.io/projected/8dc85899-cb25-4bc3-a620-a9d5ea360654-kube-api-access-hv6tp\") pod \"payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz\" (UID: \"8dc85899-cb25-4bc3-a620-a9d5ea360654\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:38.668505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.668391    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc85899-cb25-4bc3-a620-a9d5ea360654-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz\" (UID: \"8dc85899-cb25-4bc3-a620-a9d5ea360654\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:38.682118 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.682090    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:38.772545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.772504    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv6tp\" (UniqueName: \"kubernetes.io/projected/8dc85899-cb25-4bc3-a620-a9d5ea360654-kube-api-access-hv6tp\") pod \"payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz\" (UID: \"8dc85899-cb25-4bc3-a620-a9d5ea360654\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:38.772748 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.772618    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc85899-cb25-4bc3-a620-a9d5ea360654-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz\" (UID: \"8dc85899-cb25-4bc3-a620-a9d5ea360654\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:38.773469 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.773447    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc85899-cb25-4bc3-a620-a9d5ea360654-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz\" (UID: \"8dc85899-cb25-4bc3-a620-a9d5ea360654\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:38.834012 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:38.833976    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv6tp\" (UniqueName: \"kubernetes.io/projected/8dc85899-cb25-4bc3-a620-a9d5ea360654-kube-api-access-hv6tp\") pod \"payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz\" (UID: \"8dc85899-cb25-4bc3-a620-a9d5ea360654\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:39.067303 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:39.067263    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"]
Nov 01 04:19:39.069303 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:19:39.069274    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc28cc2c_c119_4f2d_8f4e_ea328585c311.slice/crio-0c77e4ab747b8a50c445025080a4f1e48f91fdfd2cbe916c0d80aebd370e5bb6 WatchSource:0}: Error finding container 0c77e4ab747b8a50c445025080a4f1e48f91fdfd2cbe916c0d80aebd370e5bb6: Status 404 returned error can't find the container with id 0c77e4ab747b8a50c445025080a4f1e48f91fdfd2cbe916c0d80aebd370e5bb6
Nov 01 04:19:39.129730 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:39.129703    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:39.506329 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:39.506288    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb" event={"ID":"dc28cc2c-c119-4f2d-8f4e-ea328585c311","Type":"ContainerStarted","Data":"e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead"}
Nov 01 04:19:39.506533 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:39.506364    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:39.506533 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:39.506388    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb" event={"ID":"dc28cc2c-c119-4f2d-8f4e-ea328585c311","Type":"ContainerStarted","Data":"0c77e4ab747b8a50c445025080a4f1e48f91fdfd2cbe916c0d80aebd370e5bb6"}
Nov 01 04:19:39.512789 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:39.512751    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"]
Nov 01 04:19:39.515593 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:19:39.515568    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc85899_cb25_4bc3_a620_a9d5ea360654.slice/crio-4c73c11a6ad8858fb675b7ddf1a3ecd4974242b521e083cea700f0077aeccad9 WatchSource:0}: Error finding container 4c73c11a6ad8858fb675b7ddf1a3ecd4974242b521e083cea700f0077aeccad9: Status 404 returned error can't find the container with id 4c73c11a6ad8858fb675b7ddf1a3ecd4974242b521e083cea700f0077aeccad9
Nov 01 04:19:39.627106 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:39.627041    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb" podStartSLOduration=1.6270245330000002 podStartE2EDuration="1.627024533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:19:39.624427967 +0000 UTC m=+2200.384155762" watchObservedRunningTime="2026-11-01 04:19:39.627024533 +0000 UTC m=+2200.386752330"
Nov 01 04:19:40.515463 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:40.515424    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz" event={"ID":"8dc85899-cb25-4bc3-a620-a9d5ea360654","Type":"ContainerStarted","Data":"827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6"}
Nov 01 04:19:40.515976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:40.515491    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz" event={"ID":"8dc85899-cb25-4bc3-a620-a9d5ea360654","Type":"ContainerStarted","Data":"4c73c11a6ad8858fb675b7ddf1a3ecd4974242b521e083cea700f0077aeccad9"}
Nov 01 04:19:40.515976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:40.515652    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:40.634114 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:40.634060    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz" podStartSLOduration=2.6340448629999997 podStartE2EDuration="2.634044863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:19:40.631641224 +0000 UTC m=+2201.391369020" watchObservedRunningTime="2026-11-01 04:19:40.634044863 +0000 UTC m=+2201.393772676"
Nov 01 04:19:41.628560 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:41.628498    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:43.220331 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:43.220299    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:43.852888 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:43.852815    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:44.054332 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:44.054294    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:44.287288 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:19:44.287247    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:19:46.980636 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:46.980585    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:47.179027 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:47.178942    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:47.378318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:47.378283    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:50.519175 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:50.519136    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:19:51.526306 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:51.526277    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:19:52.263649 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:52.263599    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:19:57.207382 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:19:57.207332    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:00.219260 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:00.219205    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:01.503799 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:01.503766    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:02.135182 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:02.135137    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:02.431251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:02.431132    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:02.749361 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:02.749280    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:06.164555 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:06.164516    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:06.384372 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:06.384334    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:06.587928 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:06.587847    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:08.097261 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:08.097226    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:09.362978 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:09.362942    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:09.560122 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:09.560088    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:13.719979 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:13.719947    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:13.918634 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:13.918600    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:14.285364 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:20:14.285324    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:20:19.160671 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:19.160625    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:23.851441 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:23.851399    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:24.268618 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:24.268571    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:24.536232 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:24.536119    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:25.466062 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:25.466026    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:26.254292 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:26.254252    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:26.468437 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:26.468405    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:29.672318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:29.672280    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:29.871600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:29.871570    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:30.067852 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:30.067762    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:30.572702 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:30.572673    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:30.769702 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:30.769671    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:33.746042 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:33.746009    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:33.942630 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:33.942597    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:34.099154 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.099074    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"]
Nov 01 04:20:34.103176 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.103148    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:34.157872 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.157836    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"]
Nov 01 04:20:34.166504 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.166472    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff51bec-fa78-4201-9718-1605b17c6ba4-plugins-config-volume\") pod \"payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm\" (UID: \"1ff51bec-fa78-4201-9718-1605b17c6ba4\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:34.166827 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.166764    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjtjr\" (UniqueName: \"kubernetes.io/projected/1ff51bec-fa78-4201-9718-1605b17c6ba4-kube-api-access-zjtjr\") pod \"payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm\" (UID: \"1ff51bec-fa78-4201-9718-1605b17c6ba4\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:34.211902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.211867    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-praxis-b-862ad1\""
Nov 01 04:20:34.212955 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.212322    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-praxis-b-862ad1-dockercfg-6v9lm\""
Nov 01 04:20:34.268360 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.268329    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjtjr\" (UniqueName: \"kubernetes.io/projected/1ff51bec-fa78-4201-9718-1605b17c6ba4-kube-api-access-zjtjr\") pod \"payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm\" (UID: \"1ff51bec-fa78-4201-9718-1605b17c6ba4\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:34.268360 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.268371    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff51bec-fa78-4201-9718-1605b17c6ba4-plugins-config-volume\") pod \"payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm\" (UID: \"1ff51bec-fa78-4201-9718-1605b17c6ba4\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:34.269147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.269123    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff51bec-fa78-4201-9718-1605b17c6ba4-plugins-config-volume\") pod \"payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm\" (UID: \"1ff51bec-fa78-4201-9718-1605b17c6ba4\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:34.330022 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.329978    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjtjr\" (UniqueName: \"kubernetes.io/projected/1ff51bec-fa78-4201-9718-1605b17c6ba4-kube-api-access-zjtjr\") pod \"payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm\" (UID: \"1ff51bec-fa78-4201-9718-1605b17c6ba4\") " pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:34.417076 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.417034    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:34.802037 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.801995    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"]
Nov 01 04:20:34.804430 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:20:34.804400    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff51bec_fa78_4201_9718_1605b17c6ba4.slice/crio-085f6f0a4e2c21ccf0c2d74c9db76fca465309b0b9c2d4126b4c0cfe8805c9ac WatchSource:0}: Error finding container 085f6f0a4e2c21ccf0c2d74c9db76fca465309b0b9c2d4126b4c0cfe8805c9ac: Status 404 returned error can't find the container with id 085f6f0a4e2c21ccf0c2d74c9db76fca465309b0b9c2d4126b4c0cfe8805c9ac
Nov 01 04:20:34.921125 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.921085    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm" event={"ID":"1ff51bec-fa78-4201-9718-1605b17c6ba4","Type":"ContainerStarted","Data":"aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be"}
Nov 01 04:20:34.921347 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.921152    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm" event={"ID":"1ff51bec-fa78-4201-9718-1605b17c6ba4","Type":"ContainerStarted","Data":"085f6f0a4e2c21ccf0c2d74c9db76fca465309b0b9c2d4126b4c0cfe8805c9ac"}
Nov 01 04:20:34.921347 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:34.921196    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:35.040549 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:35.040496    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm" podStartSLOduration=1.040480417 podStartE2EDuration="1.040480417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:20:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:20:35.036892921 +0000 UTC m=+2255.796620717" watchObservedRunningTime="2026-11-01 04:20:35.040480417 +0000 UTC m=+2255.800208254"
Nov 01 04:20:37.553580 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:37.553539    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:41.344819 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:41.344786    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:41.546562 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:41.546528    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:44.207878 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:44.207839    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:44.285312 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:20:44.285276    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:20:45.937839 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:45.937811    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:20:49.225968 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:49.225930    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:20:54.321189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:20:54.321119    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:01.904504 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:01.904464    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:02.101431 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:02.101398    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:06.228513 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:06.228468    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:09.898718 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:09.898643    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:10.404148 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:10.404110    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:13.064296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:13.064259    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:14.062786 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:14.062754    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:14.285053 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:21:14.285014    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:21:18.034748 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:18.034712    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:23.045800 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:23.045766    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:24.208267 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:24.208232    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:28.320069 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:28.320030    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:33.920426 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:33.920369    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:38.786703 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.786668    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"]
Nov 01 04:21:38.790842 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.790808    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.848058 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.848027    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvtm\" (UniqueName: \"kubernetes.io/projected/386d19de-8a52-4288-885a-bc1c99cc71d9-kube-api-access-hcvtm\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.848262 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.848096    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-metrics-certs\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.848262 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.848237    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/386d19de-8a52-4288-885a-bc1c99cc71d9-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.848395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.848374    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.870342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.870305    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-b-2afc0d-serving-cert\""
Nov 01 04:21:38.924257 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.924221    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"]
Nov 01 04:21:38.949401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.949370    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.949584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.949520    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvtm\" (UniqueName: \"kubernetes.io/projected/386d19de-8a52-4288-885a-bc1c99cc71d9-kube-api-access-hcvtm\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.949584 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:21:38.949523    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-serving-cert: secret "maas-api-e2e-praxis-b-2afc0d-serving-cert" not found
Nov 01 04:21:38.949584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.949556    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-metrics-certs\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.949584 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:21:38.949584    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls podName:386d19de-8a52-4288-885a-bc1c99cc71d9 nodeName:}" failed. No retries permitted until 2026-11-01 04:21:39.449568684 +0000 UTC m=+2320.209296458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls") pod "maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4" (UID: "386d19de-8a52-4288-885a-bc1c99cc71d9") : secret "maas-api-e2e-praxis-b-2afc0d-serving-cert" not found
Nov 01 04:21:38.949833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.949629    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/386d19de-8a52-4288-885a-bc1c99cc71d9-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.950293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.950267    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/386d19de-8a52-4288-885a-bc1c99cc71d9-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:38.951953 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:38.951928    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-metrics-certs\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:39.011391 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:39.011356    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvtm\" (UniqueName: \"kubernetes.io/projected/386d19de-8a52-4288-885a-bc1c99cc71d9-kube-api-access-hcvtm\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:39.101697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:39.101619    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:39.301634 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:39.301599    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:39.457002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:39.456963    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:39.459428 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:39.459400    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls\") pod \"maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:39.705258 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:39.705218    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:40.089527 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:21:40.089490    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386d19de_8a52_4288_885a_bc1c99cc71d9.slice/crio-184c750b5ec164c3710c34b7e56e53b5e6a3fd2d620dc441dd9619a8185cc676 WatchSource:0}: Error finding container 184c750b5ec164c3710c34b7e56e53b5e6a3fd2d620dc441dd9619a8185cc676: Status 404 returned error can't find the container with id 184c750b5ec164c3710c34b7e56e53b5e6a3fd2d620dc441dd9619a8185cc676
Nov 01 04:21:40.091016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:40.090998    5529 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 04:21:40.098966 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:40.098934    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"]
Nov 01 04:21:40.396141 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:40.396106    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4" event={"ID":"386d19de-8a52-4288-885a-bc1c99cc71d9","Type":"ContainerStarted","Data":"184c750b5ec164c3710c34b7e56e53b5e6a3fd2d620dc441dd9619a8185cc676"}
Nov 01 04:21:41.405391 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:41.405356    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4" event={"ID":"386d19de-8a52-4288-885a-bc1c99cc71d9","Type":"ContainerStarted","Data":"ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68"}
Nov 01 04:21:41.405804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:41.405421    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:41.525796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:41.525746    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4" podStartSLOduration=2.666562036 podStartE2EDuration="3.525731418s" totalImagesPullingTime="859.169382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:21:41.523817069 +0000 UTC m=+2322.283544864" watchObservedRunningTime="2026-11-01 04:21:41.525731418 +0000 UTC m=+2322.285459274"
Nov 01 04:21:44.222733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:44.222698    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:44.285383 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:21:44.285339    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:21:47.419515 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:47.419484    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:21:49.198764 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:49.198728    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:54.119706 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:54.119546    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:21:59.118739 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:21:59.118655    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:03.714273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.714242    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"]
Nov 01 04:22:03.718538 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.718517    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.774421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.774385    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"]
Nov 01 04:22:03.820457 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.820421    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-praxis-b-862ad1-serving-cert\""
Nov 01 04:22:03.857698 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.857653    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrd8w\" (UniqueName: \"kubernetes.io/projected/74567db5-3977-4daf-9202-8ac4c8c8dc38-kube-api-access-qrd8w\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.857891 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.857782    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74567db5-3977-4daf-9202-8ac4c8c8dc38-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.858001 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.857976    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-metrics-certs\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.858067 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.858034    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.910094 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.910064    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:03.959197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.959138    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrd8w\" (UniqueName: \"kubernetes.io/projected/74567db5-3977-4daf-9202-8ac4c8c8dc38-kube-api-access-qrd8w\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.959435 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.959221    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74567db5-3977-4daf-9202-8ac4c8c8dc38-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.959435 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.959362    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-metrics-certs\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.959435 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.959398    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.959617 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:22:03.959535    5529 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-serving-cert: secret "maas-api-e2e-praxis-b-862ad1-serving-cert" not found
Nov 01 04:22:03.959617 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:22:03.959593    5529 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls podName:74567db5-3977-4daf-9202-8ac4c8c8dc38 nodeName:}" failed. No retries permitted until 2026-11-01 04:22:04.459578447 +0000 UTC m=+2345.219306220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls") pod "maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8" (UID: "74567db5-3977-4daf-9202-8ac4c8c8dc38") : secret "maas-api-e2e-praxis-b-862ad1-serving-cert" not found
Nov 01 04:22:03.960695 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.960670    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74567db5-3977-4daf-9202-8ac4c8c8dc38-openshift-service-ca\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:03.963356 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:03.963292    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-metrics-certs\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:04.021761 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:04.021686    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrd8w\" (UniqueName: \"kubernetes.io/projected/74567db5-3977-4daf-9202-8ac4c8c8dc38-kube-api-access-qrd8w\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:04.140205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:04.139834    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:04.342359 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:04.342264    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:04.465066 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:04.465033    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:04.467555 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:04.467525    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls\") pod \"maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") " pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:04.632961 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:04.632927    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:05.018132 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:05.018104    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"]
Nov 01 04:22:05.021556 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:22:05.020721    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74567db5_3977_4daf_9202_8ac4c8c8dc38.slice/crio-d222e35b97e301cb7e0b0bc487171d88ff4799137bc4820bccbc0abbd0a2b1b8 WatchSource:0}: Error finding container d222e35b97e301cb7e0b0bc487171d88ff4799137bc4820bccbc0abbd0a2b1b8: Status 404 returned error can't find the container with id d222e35b97e301cb7e0b0bc487171d88ff4799137bc4820bccbc0abbd0a2b1b8
Nov 01 04:22:05.577584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:05.577541    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8" event={"ID":"74567db5-3977-4daf-9202-8ac4c8c8dc38","Type":"ContainerStarted","Data":"d222e35b97e301cb7e0b0bc487171d88ff4799137bc4820bccbc0abbd0a2b1b8"}
Nov 01 04:22:06.589361 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:06.589208    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8" event={"ID":"74567db5-3977-4daf-9202-8ac4c8c8dc38","Type":"ContainerStarted","Data":"63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb"}
Nov 01 04:22:06.589796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:06.589484    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:06.712774 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:06.712720    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8" podStartSLOduration=2.770709706 podStartE2EDuration="3.712706326s" totalImagesPullingTime="941.99662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:22:06.708440128 +0000 UTC m=+2347.468167945" watchObservedRunningTime="2026-11-01 04:22:06.712706326 +0000 UTC m=+2347.472434122"
Nov 01 04:22:09.267196 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:09.266465    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:12.601500 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:12.601470    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:22:14.284761 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:22:14.284720    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:22:14.405377 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:14.405342    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:15.168480 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.168446    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"]
Nov 01 04:22:15.168679 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.168644    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt" podUID="96138547-d4dd-450b-8b63-92753452d3bb" containerName="maas-api" containerID="cri-o://ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594" gracePeriod=30
Nov 01 04:22:15.324289 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.324246    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:15.477829 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.477792    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:22:15.595541 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.595507    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96138547-d4dd-450b-8b63-92753452d3bb-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96138547-d4dd-450b-8b63-92753452d3bb-openshift-service-ca\") pod \"96138547-d4dd-450b-8b63-92753452d3bb\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") "
Nov 01 04:22:15.598298 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.596040    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96138547-d4dd-450b-8b63-92753452d3bb-openshift-service-ca" pod "96138547-d4dd-450b-8b63-92753452d3bb" (UID: "96138547-d4dd-450b-8b63-92753452d3bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:22:15.598491 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.598472    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96138547-d4dd-450b-8b63-92753452d3bb-kube-api-access-4mxqh\" (UniqueName: \"kubernetes.io/projected/96138547-d4dd-450b-8b63-92753452d3bb-kube-api-access-4mxqh\") pod \"96138547-d4dd-450b-8b63-92753452d3bb\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") "
Nov 01 04:22:15.607218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.598928    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-metrics-certs\") pod \"96138547-d4dd-450b-8b63-92753452d3bb\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") "
Nov 01 04:22:15.607218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.599412    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls\") pod \"96138547-d4dd-450b-8b63-92753452d3bb\" (UID: \"96138547-d4dd-450b-8b63-92753452d3bb\") "
Nov 01 04:22:15.607218 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.600267    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96138547-d4dd-450b-8b63-92753452d3bb-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:15.617625 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.616783    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-metrics-certs" pod "96138547-d4dd-450b-8b63-92753452d3bb" (UID: "96138547-d4dd-450b-8b63-92753452d3bb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:22:15.617625 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.617411    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96138547-d4dd-450b-8b63-92753452d3bb-kube-api-access-4mxqh" pod "96138547-d4dd-450b-8b63-92753452d3bb" (UID: "96138547-d4dd-450b-8b63-92753452d3bb"). InnerVolumeSpecName "kube-api-access-4mxqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:22:15.619381 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.619344    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls" pod "96138547-d4dd-450b-8b63-92753452d3bb" (UID: "96138547-d4dd-450b-8b63-92753452d3bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:22:15.655598 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.655567    5529 generic.go:356] "Generic (PLEG): container finished" podID="96138547-d4dd-450b-8b63-92753452d3bb" containerID="ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594" exitCode=0
Nov 01 04:22:15.655768 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.655625    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"
Nov 01 04:22:15.655768 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.655743    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt" event={"ID":"96138547-d4dd-450b-8b63-92753452d3bb","Type":"ContainerDied","Data":"ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594"}
Nov 01 04:22:15.655899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.655792    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt" event={"ID":"96138547-d4dd-450b-8b63-92753452d3bb","Type":"ContainerDied","Data":"0b1ce8967450e01bc04614a5593d295cd8b50cac011637ee829d7ce17e2b9c8d"}
Nov 01 04:22:15.655899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.655823    5529 scope.go:122] "RemoveContainer" containerID="ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594"
Nov 01 04:22:15.667849 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.667823    5529 scope.go:122] "RemoveContainer" containerID="ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594"
Nov 01 04:22:15.668274 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:22:15.668250    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594\": container with ID starting with ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594 not found: ID does not exist" containerID="ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594"
Nov 01 04:22:15.668353 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.668285    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594"} err="failed to get container status \"ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594\": rpc error: code = NotFound desc = could not find container \"ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594\": container with ID starting with ebd41193f640a5491af262bca211d2745e54d23b32652bf0dc905373b51a0594 not found: ID does not exist"
Nov 01 04:22:15.701709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.701616    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:15.701709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.701647    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mxqh\" (UniqueName: \"kubernetes.io/projected/96138547-d4dd-450b-8b63-92753452d3bb-kube-api-access-4mxqh\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:15.701709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.701660    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96138547-d4dd-450b-8b63-92753452d3bb-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:15.828316 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.828283    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"]
Nov 01 04:22:15.831355 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.831328    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-131718-78b8fbf5bf-s88tt"]
Nov 01 04:22:15.848256 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:15.848224    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:16.048835 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:16.048748    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:16.923852 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:16.923818    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:17.145928 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:17.145896    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:17.343876 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:17.343796    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:17.378230 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:17.378188    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96138547-d4dd-450b-8b63-92753452d3bb" path="/var/lib/kubelet/pods/96138547-d4dd-450b-8b63-92753452d3bb/volumes"
Nov 01 04:22:18.023002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:18.022967    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:22.524826 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:22.524786    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:23.846665 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:23.846630    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:24.050201 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:24.050158    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:24.254505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:24.254468    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:24.571989 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:24.571914    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:27.042368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:27.042331    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:27.625112 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:27.625075    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:27.819947 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:27.819911    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:28.018033 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:28.017937    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:28.857457 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:28.857424    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:29.121598 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:29.121520    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:29.319901 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:29.319864    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:29.811952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:29.811895    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:34.829294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:34.829255    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:36.324133 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:36.324067    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:36.532389 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:36.532350    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:36.734621 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:36.734583    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:41.621603 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:41.621570    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:41.826571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:41.826541    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:42.053593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:42.053536    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:42.951630 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:42.951592    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"]
Nov 01 04:22:42.952087 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:42.951869    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy" containerID="cri-o://f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790" gracePeriod=30
Nov 01 04:22:44.287278 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:22:44.287239    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:22:47.302562 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:47.302464    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:48.220842 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.220770    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:22:48.307338 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307293    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-token\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-token\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307361    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-data\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307429    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-certs\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307485    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-envoy\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307540    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istiod-ca-cert\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307646    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-data" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307669    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-credential-socket\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307720    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-kube-api-access-jrrl4\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-kube-api-access-jrrl4\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307730    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-certs" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307750    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-socket\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.307862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307814    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-podinfo\") pod \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\" (UID: \"99f7bc02-66fe-43d2-abaf-e5bd85d256ef\") "
Nov 01 04:22:48.308423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.307961    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-credential-socket" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:22:48.308423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.308057    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-socket" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:22:48.308423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.308102    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istiod-ca-cert" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:22:48.308423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.308376    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.308423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.308398    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.308423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.308408    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.308423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.308419    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.308805 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.308434    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.309796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.309770    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-envoy" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:22:48.310007 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.309986    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-token" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:22:48.310310 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.310293    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-podinfo" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:22:48.310395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.310382    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-kube-api-access-jrrl4" pod "99f7bc02-66fe-43d2-abaf-e5bd85d256ef" (UID: "99f7bc02-66fe-43d2-abaf-e5bd85d256ef"). InnerVolumeSpecName "kube-api-access-jrrl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:22:48.409661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.409626    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrrl4\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-kube-api-access-jrrl4\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.409661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.409662    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.409661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.409677    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.409661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.409692    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99f7bc02-66fe-43d2-abaf-e5bd85d256ef-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:48.857177 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.857128    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"]
Nov 01 04:22:48.918874 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.918837    5529 generic.go:356] "Generic (PLEG): container finished" podID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerID="f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790" exitCode=0
Nov 01 04:22:48.919082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.918894    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"
Nov 01 04:22:48.919082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.918925    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" event={"ID":"99f7bc02-66fe-43d2-abaf-e5bd85d256ef","Type":"ContainerDied","Data":"f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790"}
Nov 01 04:22:48.919082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.918995    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x" event={"ID":"99f7bc02-66fe-43d2-abaf-e5bd85d256ef","Type":"ContainerDied","Data":"ff1d50b4be8d488b7fd90f8f7c00e48b2022fe119372f73573da9bb89078aee9"}
Nov 01 04:22:48.919082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.919025    5529 scope.go:122] "RemoveContainer" containerID="f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790"
Nov 01 04:22:48.931099 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.931078    5529 scope.go:122] "RemoveContainer" containerID="f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790"
Nov 01 04:22:48.931437 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:22:48.931415    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790\": container with ID starting with f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790 not found: ID does not exist" containerID="f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790"
Nov 01 04:22:48.931544 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.931447    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790"} err="failed to get container status \"f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790\": rpc error: code = NotFound desc = could not find container \"f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790\": container with ID starting with f19478ae2df4efe6940c38bec73ceecf8d80d7c03295d71f4a5a967bb9850790 not found: ID does not exist"
Nov 01 04:22:48.954661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:48.954629    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"]
Nov 01 04:22:49.203875 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:49.203838    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"]
Nov 01 04:22:49.210259 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:49.210223    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-f73b9f-openshift-default-7cb5c77d8f-h6l5x"]
Nov 01 04:22:49.250574 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:49.250541    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:49.374718 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:49.374684    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" path="/var/lib/kubelet/pods/99f7bc02-66fe-43d2-abaf-e5bd85d256ef/volumes"
Nov 01 04:22:49.450657 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:49.450624    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:52.160207 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:52.160174    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:53.857666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:53.857624    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9" podUID="962b62e4-012a-428f-817f-8e23bb401747" containerName="payload-processing" containerID="cri-o://32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55" gracePeriod=25
Nov 01 04:22:53.955024 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:53.954978    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr" podUID="a0c7daf5-033c-4d12-81ac-1ae555cc6fa1" containerName="payload-pre-processing" containerID="cri-o://2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8" gracePeriod=25
Nov 01 04:22:54.137896 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.137865    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:22:54.244277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.244246    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:22:54.275178 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.275135    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/962b62e4-012a-428f-817f-8e23bb401747-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962b62e4-012a-428f-817f-8e23bb401747-plugins-config-volume\") pod \"962b62e4-012a-428f-817f-8e23bb401747\" (UID: \"962b62e4-012a-428f-817f-8e23bb401747\") "
Nov 01 04:22:54.275373 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.275257    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/962b62e4-012a-428f-817f-8e23bb401747-kube-api-access-9f7vx\" (UniqueName: \"kubernetes.io/projected/962b62e4-012a-428f-817f-8e23bb401747-kube-api-access-9f7vx\") pod \"962b62e4-012a-428f-817f-8e23bb401747\" (UID: \"962b62e4-012a-428f-817f-8e23bb401747\") "
Nov 01 04:22:54.275573 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.275549    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/962b62e4-012a-428f-817f-8e23bb401747-plugins-config-volume" pod "962b62e4-012a-428f-817f-8e23bb401747" (UID: "962b62e4-012a-428f-817f-8e23bb401747"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:22:54.275797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.275780    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/962b62e4-012a-428f-817f-8e23bb401747-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:54.277441 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.277419    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/962b62e4-012a-428f-817f-8e23bb401747-kube-api-access-9f7vx" pod "962b62e4-012a-428f-817f-8e23bb401747" (UID: "962b62e4-012a-428f-817f-8e23bb401747"). InnerVolumeSpecName "kube-api-access-9f7vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:22:54.376895 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.376865    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-kube-api-access-x42qd\" (UniqueName: \"kubernetes.io/projected/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-kube-api-access-x42qd\") pod \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\" (UID: \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\") "
Nov 01 04:22:54.377060 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.376918    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-plugins-config-volume\") pod \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\" (UID: \"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1\") "
Nov 01 04:22:54.377331 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.377309    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f7vx\" (UniqueName: \"kubernetes.io/projected/962b62e4-012a-428f-817f-8e23bb401747-kube-api-access-9f7vx\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:54.377400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.377379    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-plugins-config-volume" pod "a0c7daf5-033c-4d12-81ac-1ae555cc6fa1" (UID: "a0c7daf5-033c-4d12-81ac-1ae555cc6fa1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:22:54.379029 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.379006    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-kube-api-access-x42qd" pod "a0c7daf5-033c-4d12-81ac-1ae555cc6fa1" (UID: "a0c7daf5-033c-4d12-81ac-1ae555cc6fa1"). InnerVolumeSpecName "kube-api-access-x42qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:22:54.478707 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.478667    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x42qd\" (UniqueName: \"kubernetes.io/projected/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-kube-api-access-x42qd\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:54.478707 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.478709    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:22:54.965181 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.965135    5529 generic.go:356] "Generic (PLEG): container finished" podID="a0c7daf5-033c-4d12-81ac-1ae555cc6fa1" containerID="2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8" exitCode=0
Nov 01 04:22:54.965659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.965196    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"
Nov 01 04:22:54.965659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.965215    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr" event={"ID":"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1","Type":"ContainerDied","Data":"2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8"}
Nov 01 04:22:54.965659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.965268    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr" event={"ID":"a0c7daf5-033c-4d12-81ac-1ae555cc6fa1","Type":"ContainerDied","Data":"0f3f52fe6b950968c330954f616f8a5191c011cc87a536a87453f2d47dbbcdae"}
Nov 01 04:22:54.965659 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.965290    5529 scope.go:122] "RemoveContainer" containerID="2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8"
Nov 01 04:22:54.966797 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.966775    5529 generic.go:356] "Generic (PLEG): container finished" podID="962b62e4-012a-428f-817f-8e23bb401747" containerID="32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55" exitCode=0
Nov 01 04:22:54.966921 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.966817    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9" event={"ID":"962b62e4-012a-428f-817f-8e23bb401747","Type":"ContainerDied","Data":"32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55"}
Nov 01 04:22:54.966921 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.966833    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"
Nov 01 04:22:54.966921 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.966857    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9" event={"ID":"962b62e4-012a-428f-817f-8e23bb401747","Type":"ContainerDied","Data":"e3a2f987e2396cdc1d8a0295eced8e6ee56454e9d4885a7a50532d2675791710"}
Nov 01 04:22:54.978059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.978032    5529 scope.go:122] "RemoveContainer" containerID="2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8"
Nov 01 04:22:54.978407 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:22:54.978380    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8\": container with ID starting with 2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8 not found: ID does not exist" containerID="2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8"
Nov 01 04:22:54.978497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.978419    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8"} err="failed to get container status \"2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8\": rpc error: code = NotFound desc = could not find container \"2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8\": container with ID starting with 2598385ca9f8168cbb91f7c5d517cb03d3caa7abb52c08c1dedbc02394d71fe8 not found: ID does not exist"
Nov 01 04:22:54.978497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.978446    5529 scope.go:122] "RemoveContainer" containerID="32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55"
Nov 01 04:22:54.988200 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.988173    5529 scope.go:122] "RemoveContainer" containerID="32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55"
Nov 01 04:22:54.988470 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:22:54.988447    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55\": container with ID starting with 32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55 not found: ID does not exist" containerID="32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55"
Nov 01 04:22:54.988545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:54.988483    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55"} err="failed to get container status \"32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55\": rpc error: code = NotFound desc = could not find container \"32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55\": container with ID starting with 32f4e87a5a3c647885de0b5c2adf716bb56472039e21905479b26fc00ff6dd55 not found: ID does not exist"
Nov 01 04:22:55.132663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:55.132579    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"]
Nov 01 04:22:55.182965 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:55.182929    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0ee0f8-6df8bc5ff9-59mzr"]
Nov 01 04:22:55.246646 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:55.246602    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"]
Nov 01 04:22:55.249470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:55.249441    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0ee0f8-864fc5cff5-v4lz9"]
Nov 01 04:22:55.375109 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:55.375079    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="962b62e4-012a-428f-817f-8e23bb401747" path="/var/lib/kubelet/pods/962b62e4-012a-428f-817f-8e23bb401747/volumes"
Nov 01 04:22:55.375512 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:55.375498    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0c7daf5-033c-4d12-81ac-1ae555cc6fa1" path="/var/lib/kubelet/pods/a0c7daf5-033c-4d12-81ac-1ae555cc6fa1/volumes"
Nov 01 04:22:57.092024 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:57.091993    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:22:59.754422 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:59.754391    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:22:59.765315 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:22:59.765292    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:23:02.010060 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:02.010024    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:07.145926 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:07.145690    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:12.567741 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:12.567703    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:14.285553 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:23:14.285515    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:23:14.815378 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:14.815335    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:16.567573 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:16.567508    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:16.774038 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:16.774004    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:17.933990 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:17.933951    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:23.210585 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:23.210525    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:24.964793 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:24.964758    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:28.634915 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:28.634874    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:32.731137 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:32.731102    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:34.000347 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:34.000315    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:38.792514 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:38.792421    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:39.307003 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:39.306970    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:39.511915 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:39.511880    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:40.665242 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:40.665200    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:40.867094 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:40.867046    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:41.070510 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:41.070417    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:41.321221 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:41.321050    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:41.526546 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:41.526512    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:41.729559 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:41.729525    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:44.284806 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:23:44.284766    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:23:46.103577 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:46.103546    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:47.198992 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:47.198901    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:47.846179 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:47.846119    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:48.045145 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:48.045105    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:48.236378 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:48.236346    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:51.294474 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:51.294431    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:55.916086 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:55.916050    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:56.558804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:56.558765    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:56.755843 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:56.755790    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:57.715789 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:57.715759    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:57.991093 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:57.990993    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:58.192635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:58.192589    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:23:58.692207 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:23:58.692146    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:00.473663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:00.473633    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"]
Nov 01 04:24:00.668999 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:00.668968    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"]
Nov 01 04:24:00.919361 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:00.919330    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:01.117798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:01.117759    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:02.660580 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:02.660546    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:03.830350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:03.830309    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"]
Nov 01 04:24:03.830825 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:03.830571    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm" podUID="c9425546-ab4d-4088-9b74-4f744cbbd8ca" containerName="maas-api" containerID="cri-o://6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766" gracePeriod=30
Nov 01 04:24:03.983777 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:03.983643    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:04.134662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.134635    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:24:04.211310 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.211269    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c9425546-ab4d-4088-9b74-4f744cbbd8ca-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9425546-ab4d-4088-9b74-4f744cbbd8ca-openshift-service-ca\") pod \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") "
Nov 01 04:24:04.211523 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.211357    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls\") pod \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") "
Nov 01 04:24:04.211523 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.211409    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-metrics-certs\") pod \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") "
Nov 01 04:24:04.211649 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.211565    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9425546-ab4d-4088-9b74-4f744cbbd8ca-kube-api-access-j57xv\" (UniqueName: \"kubernetes.io/projected/c9425546-ab4d-4088-9b74-4f744cbbd8ca-kube-api-access-j57xv\") pod \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\" (UID: \"c9425546-ab4d-4088-9b74-4f744cbbd8ca\") "
Nov 01 04:24:04.212089 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.212061    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9425546-ab4d-4088-9b74-4f744cbbd8ca-openshift-service-ca" pod "c9425546-ab4d-4088-9b74-4f744cbbd8ca" (UID: "c9425546-ab4d-4088-9b74-4f744cbbd8ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:24:04.214214 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.214150    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9425546-ab4d-4088-9b74-4f744cbbd8ca-kube-api-access-j57xv" pod "c9425546-ab4d-4088-9b74-4f744cbbd8ca" (UID: "c9425546-ab4d-4088-9b74-4f744cbbd8ca"). InnerVolumeSpecName "kube-api-access-j57xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:24:04.214521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.214418    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls" pod "c9425546-ab4d-4088-9b74-4f744cbbd8ca" (UID: "c9425546-ab4d-4088-9b74-4f744cbbd8ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:24:04.214521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.214499    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-metrics-certs" pod "c9425546-ab4d-4088-9b74-4f744cbbd8ca" (UID: "c9425546-ab4d-4088-9b74-4f744cbbd8ca"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:24:04.312816 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.312776    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9425546-ab4d-4088-9b74-4f744cbbd8ca-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:04.312816 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.312814    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:04.312816 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.312826    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9425546-ab4d-4088-9b74-4f744cbbd8ca-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:04.313114 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.312835    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j57xv\" (UniqueName: \"kubernetes.io/projected/c9425546-ab4d-4088-9b74-4f744cbbd8ca-kube-api-access-j57xv\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:04.381302 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.381272    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:04.489401 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.489364    5529 generic.go:356] "Generic (PLEG): container finished" podID="c9425546-ab4d-4088-9b74-4f744cbbd8ca" containerID="6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766" exitCode=0
Nov 01 04:24:04.489597 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.489408    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"
Nov 01 04:24:04.489597 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.489437    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm" event={"ID":"c9425546-ab4d-4088-9b74-4f744cbbd8ca","Type":"ContainerDied","Data":"6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766"}
Nov 01 04:24:04.489597 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.489519    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm" event={"ID":"c9425546-ab4d-4088-9b74-4f744cbbd8ca","Type":"ContainerDied","Data":"325c25bab97a58d830839f621fd95bb06c5c94ef6f3e6cdb2a94990c392f61d6"}
Nov 01 04:24:04.489597 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.489543    5529 scope.go:122] "RemoveContainer" containerID="6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766"
Nov 01 04:24:04.501177 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.501138    5529 scope.go:122] "RemoveContainer" containerID="6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766"
Nov 01 04:24:04.501508 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:24:04.501487    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766\": container with ID starting with 6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766 not found: ID does not exist" containerID="6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766"
Nov 01 04:24:04.501554 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.501521    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766"} err="failed to get container status \"6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766\": rpc error: code = NotFound desc = could not find container \"6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766\": container with ID starting with 6cf90c6a1f4fd9344ecff4d96e63e29938057225de99a43f61af2fdc8216b766 not found: ID does not exist"
Nov 01 04:24:04.656514 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.656434    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"]
Nov 01 04:24:04.659455 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.659432    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-4c2a66-64b8c44c78-wr2xm"]
Nov 01 04:24:04.677686 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:04.677641    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:05.293962 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.293926    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:05.374288 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.374254    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c9425546-ab4d-4088-9b74-4f744cbbd8ca" path="/var/lib/kubelet/pods/c9425546-ab4d-4088-9b74-4f744cbbd8ca/volumes"
Nov 01 04:24:05.474493 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.474444    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz" podUID="8dc85899-cb25-4bc3-a620-a9d5ea360654" containerName="payload-processing" containerID="cri-o://827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6" gracePeriod=25
Nov 01 04:24:05.489867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.489835    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:05.680413 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.672232    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb" podUID="dc28cc2c-c119-4f2d-8f4e-ea328585c311" containerName="payload-pre-processing" containerID="cri-o://e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead" gracePeriod=25
Nov 01 04:24:05.707583 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.707502    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:05.824815 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.824778    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:24:05.915697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.915660    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:05.931429 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.931402    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:24:05.943950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.943920    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8dc85899-cb25-4bc3-a620-a9d5ea360654-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc85899-cb25-4bc3-a620-a9d5ea360654-plugins-config-volume\") pod \"8dc85899-cb25-4bc3-a620-a9d5ea360654\" (UID: \"8dc85899-cb25-4bc3-a620-a9d5ea360654\") "
Nov 01 04:24:05.944141 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.943977    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8dc85899-cb25-4bc3-a620-a9d5ea360654-kube-api-access-hv6tp\" (UniqueName: \"kubernetes.io/projected/8dc85899-cb25-4bc3-a620-a9d5ea360654-kube-api-access-hv6tp\") pod \"8dc85899-cb25-4bc3-a620-a9d5ea360654\" (UID: \"8dc85899-cb25-4bc3-a620-a9d5ea360654\") "
Nov 01 04:24:05.944683 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.944388    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc85899-cb25-4bc3-a620-a9d5ea360654-plugins-config-volume" pod "8dc85899-cb25-4bc3-a620-a9d5ea360654" (UID: "8dc85899-cb25-4bc3-a620-a9d5ea360654"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:24:05.946380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:05.946354    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc85899-cb25-4bc3-a620-a9d5ea360654-kube-api-access-hv6tp" pod "8dc85899-cb25-4bc3-a620-a9d5ea360654" (UID: "8dc85899-cb25-4bc3-a620-a9d5ea360654"). InnerVolumeSpecName "kube-api-access-hv6tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:24:06.044804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.044762    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc28cc2c-c119-4f2d-8f4e-ea328585c311-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc28cc2c-c119-4f2d-8f4e-ea328585c311-plugins-config-volume\") pod \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\" (UID: \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\") "
Nov 01 04:24:06.044998 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.044880    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc28cc2c-c119-4f2d-8f4e-ea328585c311-kube-api-access-2vgfr\" (UniqueName: \"kubernetes.io/projected/dc28cc2c-c119-4f2d-8f4e-ea328585c311-kube-api-access-2vgfr\") pod \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\" (UID: \"dc28cc2c-c119-4f2d-8f4e-ea328585c311\") "
Nov 01 04:24:06.045138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.045125    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dc85899-cb25-4bc3-a620-a9d5ea360654-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:06.045207 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.045140    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv6tp\" (UniqueName: \"kubernetes.io/projected/8dc85899-cb25-4bc3-a620-a9d5ea360654-kube-api-access-hv6tp\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:06.045257 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.045188    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc28cc2c-c119-4f2d-8f4e-ea328585c311-plugins-config-volume" pod "dc28cc2c-c119-4f2d-8f4e-ea328585c311" (UID: "dc28cc2c-c119-4f2d-8f4e-ea328585c311"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:24:06.047049 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.047019    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc28cc2c-c119-4f2d-8f4e-ea328585c311-kube-api-access-2vgfr" pod "dc28cc2c-c119-4f2d-8f4e-ea328585c311" (UID: "dc28cc2c-c119-4f2d-8f4e-ea328585c311"). InnerVolumeSpecName "kube-api-access-2vgfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:24:06.113438 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.113339    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:06.146053 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.146021    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc28cc2c-c119-4f2d-8f4e-ea328585c311-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:06.146053 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.146050    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vgfr\" (UniqueName: \"kubernetes.io/projected/dc28cc2c-c119-4f2d-8f4e-ea328585c311-kube-api-access-2vgfr\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:06.504216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.504149    5529 generic.go:356] "Generic (PLEG): container finished" podID="8dc85899-cb25-4bc3-a620-a9d5ea360654" containerID="827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6" exitCode=0
Nov 01 04:24:06.504216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.504216    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"
Nov 01 04:24:06.504720 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.504226    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz" event={"ID":"8dc85899-cb25-4bc3-a620-a9d5ea360654","Type":"ContainerDied","Data":"827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6"}
Nov 01 04:24:06.504720 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.504276    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz" event={"ID":"8dc85899-cb25-4bc3-a620-a9d5ea360654","Type":"ContainerDied","Data":"4c73c11a6ad8858fb675b7ddf1a3ecd4974242b521e083cea700f0077aeccad9"}
Nov 01 04:24:06.504720 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.504298    5529 scope.go:122] "RemoveContainer" containerID="827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6"
Nov 01 04:24:06.505909 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.505888    5529 generic.go:356] "Generic (PLEG): container finished" podID="dc28cc2c-c119-4f2d-8f4e-ea328585c311" containerID="e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead" exitCode=0
Nov 01 04:24:06.506038 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.505929    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"
Nov 01 04:24:06.506038 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.505972    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb" event={"ID":"dc28cc2c-c119-4f2d-8f4e-ea328585c311","Type":"ContainerDied","Data":"e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead"}
Nov 01 04:24:06.506038 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.506021    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb" event={"ID":"dc28cc2c-c119-4f2d-8f4e-ea328585c311","Type":"ContainerDied","Data":"0c77e4ab747b8a50c445025080a4f1e48f91fdfd2cbe916c0d80aebd370e5bb6"}
Nov 01 04:24:06.516066 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.516047    5529 scope.go:122] "RemoveContainer" containerID="827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6"
Nov 01 04:24:06.516404 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:24:06.516383    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6\": container with ID starting with 827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6 not found: ID does not exist" containerID="827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6"
Nov 01 04:24:06.516479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.516413    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6"} err="failed to get container status \"827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6\": rpc error: code = NotFound desc = could not find container \"827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6\": container with ID starting with 827b2731ccc34528767a7382bf377926cbf86e189a2408ded835b138c585cff6 not found: ID does not exist"
Nov 01 04:24:06.516479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.516433    5529 scope.go:122] "RemoveContainer" containerID="e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead"
Nov 01 04:24:06.526759 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.526741    5529 scope.go:122] "RemoveContainer" containerID="e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead"
Nov 01 04:24:06.527029 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:24:06.527009    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead\": container with ID starting with e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead not found: ID does not exist" containerID="e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead"
Nov 01 04:24:06.527096 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.527037    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead"} err="failed to get container status \"e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead\": rpc error: code = NotFound desc = could not find container \"e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead\": container with ID starting with e55f914d2957af2e264be727ea0c51300197a766241cb1e5f07cbd1c6f614ead not found: ID does not exist"
Nov 01 04:24:06.674417 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.674384    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"]
Nov 01 04:24:06.678115 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.678084    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:06.722236 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.722204    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0882f4-67769b9d79-s9mgb"]
Nov 01 04:24:06.793083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.792997    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"]
Nov 01 04:24:06.796877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:06.796841    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0882f4-668c846c47-tt9kz"]
Nov 01 04:24:07.289630 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:07.289603    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:07.377174 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:07.377130    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8dc85899-cb25-4bc3-a620-a9d5ea360654" path="/var/lib/kubelet/pods/8dc85899-cb25-4bc3-a620-a9d5ea360654/volumes"
Nov 01 04:24:07.377620 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:07.377606    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc28cc2c-c119-4f2d-8f4e-ea328585c311" path="/var/lib/kubelet/pods/dc28cc2c-c119-4f2d-8f4e-ea328585c311/volumes"
Nov 01 04:24:07.913030 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:07.912992    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:08.121898 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:08.121871    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:11.388503 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:11.388470    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:11.587171 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:11.587125    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:11.875919 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:11.875894    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:12.382480 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:12.382442    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:12.593532 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:12.593497    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:12.800546 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:12.800464    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:13.414298 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:13.414249    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:13.613609 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:13.613573    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:13.808699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:13.808610    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:14.245551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:14.245517    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:14.311035 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:24:14.310965    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:24:14.463994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:14.463958    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:15.111205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:15.111148    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:15.660918 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:15.660883    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:15.864828 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:15.864793    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:16.954651 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:16.954598    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:18.526902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:18.526873    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:18.730086 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:18.730052    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:22.342139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:22.342100    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:23.550909 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:23.550870    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:23.759593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:23.759531    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:25.239792 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:25.239746    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:26.987436 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:26.987405    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"]
Nov 01 04:24:26.987939 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:26.987723    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q" podUID="3881b824-3057-400c-a35f-35a71dda6f43" containerName="maas-api" containerID="cri-o://c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86" gracePeriod=30
Nov 01 04:24:27.060559 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.060527    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:27.255671 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.255569    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:27.302364 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.302338    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:24:27.414727 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.414691    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls\") pod \"3881b824-3057-400c-a35f-35a71dda6f43\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") "
Nov 01 04:24:27.414931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.414742    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3881b824-3057-400c-a35f-35a71dda6f43-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881b824-3057-400c-a35f-35a71dda6f43-openshift-service-ca\") pod \"3881b824-3057-400c-a35f-35a71dda6f43\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") "
Nov 01 04:24:27.414931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.414793    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-metrics-certs\") pod \"3881b824-3057-400c-a35f-35a71dda6f43\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") "
Nov 01 04:24:27.414931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.414830    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3881b824-3057-400c-a35f-35a71dda6f43-kube-api-access-m86wm\" (UniqueName: \"kubernetes.io/projected/3881b824-3057-400c-a35f-35a71dda6f43-kube-api-access-m86wm\") pod \"3881b824-3057-400c-a35f-35a71dda6f43\" (UID: \"3881b824-3057-400c-a35f-35a71dda6f43\") "
Nov 01 04:24:27.415476 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.415450    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3881b824-3057-400c-a35f-35a71dda6f43-openshift-service-ca" pod "3881b824-3057-400c-a35f-35a71dda6f43" (UID: "3881b824-3057-400c-a35f-35a71dda6f43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:24:27.418948 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.418918    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls" pod "3881b824-3057-400c-a35f-35a71dda6f43" (UID: "3881b824-3057-400c-a35f-35a71dda6f43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:24:27.419813 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.419602    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3881b824-3057-400c-a35f-35a71dda6f43-kube-api-access-m86wm" pod "3881b824-3057-400c-a35f-35a71dda6f43" (UID: "3881b824-3057-400c-a35f-35a71dda6f43"). InnerVolumeSpecName "kube-api-access-m86wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:24:27.419813 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.419621    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-metrics-certs" pod "3881b824-3057-400c-a35f-35a71dda6f43" (UID: "3881b824-3057-400c-a35f-35a71dda6f43"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:24:27.516843 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.516755    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m86wm\" (UniqueName: \"kubernetes.io/projected/3881b824-3057-400c-a35f-35a71dda6f43-kube-api-access-m86wm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:27.516843 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.516788    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:27.516843 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.516798    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881b824-3057-400c-a35f-35a71dda6f43-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:27.516843 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.516808    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3881b824-3057-400c-a35f-35a71dda6f43-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:27.672883 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.672844    5529 generic.go:356] "Generic (PLEG): container finished" podID="3881b824-3057-400c-a35f-35a71dda6f43" containerID="c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86" exitCode=0
Nov 01 04:24:27.673059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.672898    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"
Nov 01 04:24:27.673059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.672932    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q" event={"ID":"3881b824-3057-400c-a35f-35a71dda6f43","Type":"ContainerDied","Data":"c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86"}
Nov 01 04:24:27.673059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.672988    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q" event={"ID":"3881b824-3057-400c-a35f-35a71dda6f43","Type":"ContainerDied","Data":"0597edee4b9a03575043cfc8e2172689edc3b5409eca1518a0e605c8fc46442d"}
Nov 01 04:24:27.673059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.673014    5529 scope.go:122] "RemoveContainer" containerID="c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86"
Nov 01 04:24:27.685031 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.685013    5529 scope.go:122] "RemoveContainer" containerID="c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86"
Nov 01 04:24:27.685371 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:24:27.685348    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86\": container with ID starting with c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86 not found: ID does not exist" containerID="c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86"
Nov 01 04:24:27.685442 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.685380    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86"} err="failed to get container status \"c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86\": rpc error: code = NotFound desc = could not find container \"c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86\": container with ID starting with c727893c3695b666c39c0757e2f1856af28a158aea8305de9e81e3d864d03e86 not found: ID does not exist"
Nov 01 04:24:27.839568 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.839491    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"]
Nov 01 04:24:27.890192 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:27.890147    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-a-e7c9be-857f449f4c-2bq6q"]
Nov 01 04:24:28.855314 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:28.855279    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:29.147756 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:29.147722    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:29.347791 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:29.347755    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:29.374195 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:29.374147    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3881b824-3057-400c-a35f-35a71dda6f43" path="/var/lib/kubelet/pods/3881b824-3057-400c-a35f-35a71dda6f43/volumes"
Nov 01 04:24:29.798783 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:29.798750    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:34.647608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:34.647564    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:36.195724 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:36.195682    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:36.391632 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:36.391595    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:36.600418 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:36.600325    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:40.160819 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:40.160767    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:44.284803 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:24:44.284767    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:24:45.645815 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:45.645752    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:48.900295 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:48.900258    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"]
Nov 01 04:24:49.200491 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:49.200324    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:49.400432 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:49.400364    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:50.709432 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:50.709401    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:53.901029 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:53.900957    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm" podUID="1ff51bec-fa78-4201-9718-1605b17c6ba4" containerName="payload-pre-processing" containerID="cri-o://aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be" gracePeriod=25
Nov 01 04:24:54.167195 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.167105    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:24:54.207544 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.207512    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff51bec-fa78-4201-9718-1605b17c6ba4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff51bec-fa78-4201-9718-1605b17c6ba4-plugins-config-volume\") pod \"1ff51bec-fa78-4201-9718-1605b17c6ba4\" (UID: \"1ff51bec-fa78-4201-9718-1605b17c6ba4\") "
Nov 01 04:24:54.207715 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.207706    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ff51bec-fa78-4201-9718-1605b17c6ba4-kube-api-access-zjtjr\" (UniqueName: \"kubernetes.io/projected/1ff51bec-fa78-4201-9718-1605b17c6ba4-kube-api-access-zjtjr\") pod \"1ff51bec-fa78-4201-9718-1605b17c6ba4\" (UID: \"1ff51bec-fa78-4201-9718-1605b17c6ba4\") "
Nov 01 04:24:54.207923 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.207900    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff51bec-fa78-4201-9718-1605b17c6ba4-plugins-config-volume" pod "1ff51bec-fa78-4201-9718-1605b17c6ba4" (UID: "1ff51bec-fa78-4201-9718-1605b17c6ba4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:24:54.208085 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.208068    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff51bec-fa78-4201-9718-1605b17c6ba4-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:54.209943 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.209909    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ff51bec-fa78-4201-9718-1605b17c6ba4-kube-api-access-zjtjr" pod "1ff51bec-fa78-4201-9718-1605b17c6ba4" (UID: "1ff51bec-fa78-4201-9718-1605b17c6ba4"). InnerVolumeSpecName "kube-api-access-zjtjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:24:54.308863 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.308827    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjtjr\" (UniqueName: \"kubernetes.io/projected/1ff51bec-fa78-4201-9718-1605b17c6ba4-kube-api-access-zjtjr\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:24:54.856236 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.856198    5529 generic.go:356] "Generic (PLEG): container finished" podID="1ff51bec-fa78-4201-9718-1605b17c6ba4" containerID="aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be" exitCode=0
Nov 01 04:24:54.856236 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.856227    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"
Nov 01 04:24:54.856488 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.856275    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm" event={"ID":"1ff51bec-fa78-4201-9718-1605b17c6ba4","Type":"ContainerDied","Data":"aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be"}
Nov 01 04:24:54.856488 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.856338    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm" event={"ID":"1ff51bec-fa78-4201-9718-1605b17c6ba4","Type":"ContainerDied","Data":"085f6f0a4e2c21ccf0c2d74c9db76fca465309b0b9c2d4126b4c0cfe8805c9ac"}
Nov 01 04:24:54.856488 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.856368    5529 scope.go:122] "RemoveContainer" containerID="aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be"
Nov 01 04:24:54.867230 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.867213    5529 scope.go:122] "RemoveContainer" containerID="aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be"
Nov 01 04:24:54.867562 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:24:54.867539    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be\": container with ID starting with aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be not found: ID does not exist" containerID="aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be"
Nov 01 04:24:54.867621 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:54.867571    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be"} err="failed to get container status \"aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be\": rpc error: code = NotFound desc = could not find container \"aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be\": container with ID starting with aba347e7bb13eba68c618854bf68be6631f38905a4c34bb32b51ce5806f425be not found: ID does not exist"
Nov 01 04:24:55.025091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:55.025028    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"]
Nov 01 04:24:55.025640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:55.025546    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:55.028463 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:55.028437    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-praxis-b-862ad1-6bd77cdf9f-c58cm"]
Nov 01 04:24:55.374766 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:55.374736    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ff51bec-fa78-4201-9718-1605b17c6ba4" path="/var/lib/kubelet/pods/1ff51bec-fa78-4201-9718-1605b17c6ba4/volumes"
Nov 01 04:24:56.628994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:56.628957    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:56.849687 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:56.849637    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:57.051705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:57.051618    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:24:57.545783 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:24:57.545745    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:02.118893 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:02.118836    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:03.563115 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:03.563082    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:03.771238 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:03.771197    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:03.967059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:03.967023    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:05.552751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:05.552719    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:05.680230 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:05.680200    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"]
Nov 01 04:25:05.680437 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:05.680385    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy" containerID="cri-o://c23580dc4e366e7ac2c2c56263627ef8a95a23251058c8a9b5bfc01f8a572bdd" gracePeriod=30
Nov 01 04:25:05.732000 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:05.731958    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"]
Nov 01 04:25:05.732269 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:05.732239    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy" containerID="cri-o://dc0bf10d9e9931eebe0ec0c6b0f19cdfaa650cc2ac844951eef110bfdcf6111a" gracePeriod=30
Nov 01 04:25:06.730482 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:06.730427    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:06.925227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:06.925191    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:07.127478 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:07.127435    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:07.324722 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:07.324663    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:10.712823 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:10.712782    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:10.918270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:10.917719    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:10.993511 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:10.993477    5529 generic.go:356] "Generic (PLEG): container finished" podID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerID="dc0bf10d9e9931eebe0ec0c6b0f19cdfaa650cc2ac844951eef110bfdcf6111a" exitCode=0
Nov 01 04:25:10.993662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:10.993549    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" event={"ID":"44dfbaba-e6c6-42c1-9370-0af412e38f2f","Type":"ContainerDied","Data":"dc0bf10d9e9931eebe0ec0c6b0f19cdfaa650cc2ac844951eef110bfdcf6111a"}
Nov 01 04:25:11.001925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.001889    5529 generic.go:356] "Generic (PLEG): container finished" podID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerID="c23580dc4e366e7ac2c2c56263627ef8a95a23251058c8a9b5bfc01f8a572bdd" exitCode=0
Nov 01 04:25:11.002074 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.001956    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" event={"ID":"226ba30c-9da4-4067-ba55-0a030c13a7d4","Type":"ContainerDied","Data":"c23580dc4e366e7ac2c2c56263627ef8a95a23251058c8a9b5bfc01f8a572bdd"}
Nov 01 04:25:11.002074 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.002017    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4" event={"ID":"226ba30c-9da4-4067-ba55-0a030c13a7d4","Type":"ContainerDied","Data":"71378b8b44a20ae93a683d32675c54b6bedd80d5c6407aa11b1bd1c02adbc5d8"}
Nov 01 04:25:11.002074 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.002042    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71378b8b44a20ae93a683d32675c54b6bedd80d5c6407aa11b1bd1c02adbc5d8"
Nov 01 04:25:11.005362 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.005334    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 04:25:11.044824 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.044800    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 04:25:11.094485 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094445    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/226ba30c-9da4-4067-ba55-0a030c13a7d4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226ba30c-9da4-4067-ba55-0a030c13a7d4-istiod-ca-cert\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.094675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094523    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-socket\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.094675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094562    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-podinfo\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.094675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094587    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-data\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.094811 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094689    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-kube-api-access-6q4pd\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-kube-api-access-6q4pd\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.094811 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094757    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-token\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-token\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.094885 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094865    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-credential-socket\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.094925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094887    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-socket" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.094925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094896    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ba30c-9da4-4067-ba55-0a030c13a7d4-istiod-ca-cert" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:25:11.094925 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.094897    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-certs\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.095063 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095016    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-envoy\") pod \"226ba30c-9da4-4067-ba55-0a030c13a7d4\" (UID: \"226ba30c-9da4-4067-ba55-0a030c13a7d4\") "
Nov 01 04:25:11.095231 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095209    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-certs" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.095231 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095224    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-credential-socket" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.095379 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095274    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-data" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.095531 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095512    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.095666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095535    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.095666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095549    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226ba30c-9da4-4067-ba55-0a030c13a7d4-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.095666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095558    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.095666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.095566    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.097043 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.097016    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-token" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:25:11.097043 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.097029    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-podinfo" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:25:11.097260 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.097243    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-kube-api-access-6q4pd" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "kube-api-access-6q4pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:25:11.097346 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.097322    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-envoy" pod "226ba30c-9da4-4067-ba55-0a030c13a7d4" (UID: "226ba30c-9da4-4067-ba55-0a030c13a7d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.196758 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.196714    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-certs\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.196932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.196781    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-data\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.196932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.196814    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-kube-api-access-xk2cd\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-kube-api-access-xk2cd\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.196932 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.196881    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-podinfo\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.197123 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.196939    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-token\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-token\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.197123 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197066    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-certs" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.197123 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197085    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-data" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.197271 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197142    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istiod-ca-cert\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.197271 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197230    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-credential-socket\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.197383 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197270    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-socket\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.197383 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197314    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-envoy\") pod \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\" (UID: \"44dfbaba-e6c6-42c1-9370-0af412e38f2f\") "
Nov 01 04:25:11.197519 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197495    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-credential-socket" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.197588 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197530    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istiod-ca-cert" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:25:11.197789 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197737    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-socket" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.197889 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197848    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.197889 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197869    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.197889 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197887    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q4pd\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-kube-api-access-6q4pd\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.198003 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197902    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.198003 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197917    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.198003 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197930    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.198003 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197944    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.198003 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197958    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.198003 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.197970    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226ba30c-9da4-4067-ba55-0a030c13a7d4-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.199712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.199685    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-envoy" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:11.199712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.199697    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-podinfo" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:25:11.199830 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.199688    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-kube-api-access-xk2cd" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "kube-api-access-xk2cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:25:11.199885 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.199858    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-token" pod "44dfbaba-e6c6-42c1-9370-0af412e38f2f" (UID: "44dfbaba-e6c6-42c1-9370-0af412e38f2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:25:11.298800 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.298709    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.298800 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.298738    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.298800 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.298749    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44dfbaba-e6c6-42c1-9370-0af412e38f2f-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:11.298800 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:11.298763    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk2cd\" (UniqueName: \"kubernetes.io/projected/44dfbaba-e6c6-42c1-9370-0af412e38f2f-kube-api-access-xk2cd\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:12.011490 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.011404    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"
Nov 01 04:25:12.011490 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.011436    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j" event={"ID":"44dfbaba-e6c6-42c1-9370-0af412e38f2f","Type":"ContainerDied","Data":"50189ac9da8756f73fa33ab19808c81012f8586a4342b912eb3bbd440d57ccdc"}
Nov 01 04:25:12.012009 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.011510    5529 scope.go:122] "RemoveContainer" containerID="dc0bf10d9e9931eebe0ec0c6b0f19cdfaa650cc2ac844951eef110bfdcf6111a"
Nov 01 04:25:12.012009 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.011671    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"
Nov 01 04:25:12.230248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.230215    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"]
Nov 01 04:25:12.278820 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.278737    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-cxmt4"]
Nov 01 04:25:12.395524 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.395489    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"]
Nov 01 04:25:12.401430 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.401402    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hq47j"]
Nov 01 04:25:12.566903 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:12.566796    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:13.373994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:13.373961    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" path="/var/lib/kubelet/pods/226ba30c-9da4-4067-ba55-0a030c13a7d4/volumes"
Nov 01 04:25:13.374488 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:13.374472    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" path="/var/lib/kubelet/pods/44dfbaba-e6c6-42c1-9370-0af412e38f2f/volumes"
Nov 01 04:25:14.284456 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:25:14.284417    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:25:15.248824 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:15.248797    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:15.448688 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:15.448656    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:15.658397 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:15.658367    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:17.079969 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.079934    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"]
Nov 01 04:25:17.080399 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.080149    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4" podUID="386d19de-8a52-4288-885a-bc1c99cc71d9" containerName="maas-api" containerID="cri-o://ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68" gracePeriod=30
Nov 01 04:25:17.234983 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.234904    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:17.390882 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.390854    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:25:17.469687 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.469646    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-metrics-certs\") pod \"386d19de-8a52-4288-885a-bc1c99cc71d9\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") "
Nov 01 04:25:17.469955 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.469935    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls\") pod \"386d19de-8a52-4288-885a-bc1c99cc71d9\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") "
Nov 01 04:25:17.470088 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.470074    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/386d19de-8a52-4288-885a-bc1c99cc71d9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/386d19de-8a52-4288-885a-bc1c99cc71d9-openshift-service-ca\") pod \"386d19de-8a52-4288-885a-bc1c99cc71d9\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") "
Nov 01 04:25:17.470247 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.470231    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/386d19de-8a52-4288-885a-bc1c99cc71d9-kube-api-access-hcvtm\" (UniqueName: \"kubernetes.io/projected/386d19de-8a52-4288-885a-bc1c99cc71d9-kube-api-access-hcvtm\") pod \"386d19de-8a52-4288-885a-bc1c99cc71d9\" (UID: \"386d19de-8a52-4288-885a-bc1c99cc71d9\") "
Nov 01 04:25:17.471799 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.471758    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/386d19de-8a52-4288-885a-bc1c99cc71d9-openshift-service-ca" pod "386d19de-8a52-4288-885a-bc1c99cc71d9" (UID: "386d19de-8a52-4288-885a-bc1c99cc71d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:25:17.473514 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.473490    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/386d19de-8a52-4288-885a-bc1c99cc71d9-kube-api-access-hcvtm" pod "386d19de-8a52-4288-885a-bc1c99cc71d9" (UID: "386d19de-8a52-4288-885a-bc1c99cc71d9"). InnerVolumeSpecName "kube-api-access-hcvtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:25:17.475988 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.475947    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-metrics-certs" pod "386d19de-8a52-4288-885a-bc1c99cc71d9" (UID: "386d19de-8a52-4288-885a-bc1c99cc71d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:25:17.482422 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.482394    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls" pod "386d19de-8a52-4288-885a-bc1c99cc71d9" (UID: "386d19de-8a52-4288-885a-bc1c99cc71d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:25:17.571627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.571588    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:17.571627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.571620    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/386d19de-8a52-4288-885a-bc1c99cc71d9-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:17.571627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.571634    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/386d19de-8a52-4288-885a-bc1c99cc71d9-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:17.571883 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:17.571645    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcvtm\" (UniqueName: \"kubernetes.io/projected/386d19de-8a52-4288-885a-bc1c99cc71d9-kube-api-access-hcvtm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:18.054927 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.054887    5529 generic.go:356] "Generic (PLEG): container finished" podID="386d19de-8a52-4288-885a-bc1c99cc71d9" containerID="ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68" exitCode=0
Nov 01 04:25:18.055151 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.054951    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"
Nov 01 04:25:18.055151 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.054986    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4" event={"ID":"386d19de-8a52-4288-885a-bc1c99cc71d9","Type":"ContainerDied","Data":"ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68"}
Nov 01 04:25:18.055151 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.055050    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4" event={"ID":"386d19de-8a52-4288-885a-bc1c99cc71d9","Type":"ContainerDied","Data":"184c750b5ec164c3710c34b7e56e53b5e6a3fd2d620dc441dd9619a8185cc676"}
Nov 01 04:25:18.055151 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.055084    5529 scope.go:122] "RemoveContainer" containerID="ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68"
Nov 01 04:25:18.074709 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.074684    5529 scope.go:122] "RemoveContainer" containerID="ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68"
Nov 01 04:25:18.075127 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:25:18.075102    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68\": container with ID starting with ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68 not found: ID does not exist" containerID="ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68"
Nov 01 04:25:18.075264 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.075134    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68"} err="failed to get container status \"ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68\": rpc error: code = NotFound desc = could not find container \"ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68\": container with ID starting with ba86dff6e9c9272696b6e2b2678eecd813474012c95d53f0df4dfd227e0b9d68 not found: ID does not exist"
Nov 01 04:25:18.220804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.220772    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"]
Nov 01 04:25:18.253968 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.253935    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-2afc0d-5cc77d4455-2sqp4"]
Nov 01 04:25:18.820097 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:18.820064    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:19.022174 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:19.022130    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:19.221285 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:19.221256    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:19.373474 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:19.373441    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="386d19de-8a52-4288-885a-bc1c99cc71d9" path="/var/lib/kubelet/pods/386d19de-8a52-4288-885a-bc1c99cc71d9/volumes"
Nov 01 04:25:19.765039 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:19.765005    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:24.501388 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:24.501354    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:25.584412 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:25.584377    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:25.817691 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:25.817658    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:26.104484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:26.104448    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:26.674438 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:26.674408    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:29.720075 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:29.719932    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:31.596034 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:31.595996    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"]
Nov 01 04:25:31.734646 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:31.734605    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:34.933740 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:34.933708    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:39.053177 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.053123    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:39.104194 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.104140    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"]
Nov 01 04:25:39.104383 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.104359    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8" podUID="74567db5-3977-4daf-9202-8ac4c8c8dc38" containerName="maas-api" containerID="cri-o://63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb" gracePeriod=30
Nov 01 04:25:39.254910 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.254854    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:39.410112 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.410081    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:25:39.458076 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.458039    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:39.543914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.543880    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74567db5-3977-4daf-9202-8ac4c8c8dc38-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74567db5-3977-4daf-9202-8ac4c8c8dc38-openshift-service-ca\") pod \"74567db5-3977-4daf-9202-8ac4c8c8dc38\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") "
Nov 01 04:25:39.544125 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.544009    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls\") pod \"74567db5-3977-4daf-9202-8ac4c8c8dc38\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") "
Nov 01 04:25:39.544125 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.544064    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74567db5-3977-4daf-9202-8ac4c8c8dc38-openshift-service-ca" pod "74567db5-3977-4daf-9202-8ac4c8c8dc38" (UID: "74567db5-3977-4daf-9202-8ac4c8c8dc38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:25:39.544290 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.544174    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-metrics-certs\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-metrics-certs\") pod \"74567db5-3977-4daf-9202-8ac4c8c8dc38\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") "
Nov 01 04:25:39.544290 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.544227    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74567db5-3977-4daf-9202-8ac4c8c8dc38-kube-api-access-qrd8w\" (UniqueName: \"kubernetes.io/projected/74567db5-3977-4daf-9202-8ac4c8c8dc38-kube-api-access-qrd8w\") pod \"74567db5-3977-4daf-9202-8ac4c8c8dc38\" (UID: \"74567db5-3977-4daf-9202-8ac4c8c8dc38\") "
Nov 01 04:25:39.544706 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.544682    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74567db5-3977-4daf-9202-8ac4c8c8dc38-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:39.546744 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.546703    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74567db5-3977-4daf-9202-8ac4c8c8dc38-kube-api-access-qrd8w" pod "74567db5-3977-4daf-9202-8ac4c8c8dc38" (UID: "74567db5-3977-4daf-9202-8ac4c8c8dc38"). InnerVolumeSpecName "kube-api-access-qrd8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:25:39.546976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.546947    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-metrics-certs" pod "74567db5-3977-4daf-9202-8ac4c8c8dc38" (UID: "74567db5-3977-4daf-9202-8ac4c8c8dc38"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:25:39.546976 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.546965    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls" pod "74567db5-3977-4daf-9202-8ac4c8c8dc38" (UID: "74567db5-3977-4daf-9202-8ac4c8c8dc38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:25:39.646319 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.646232    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:39.646319 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.646272    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrd8w\" (UniqueName: \"kubernetes.io/projected/74567db5-3977-4daf-9202-8ac4c8c8dc38-kube-api-access-qrd8w\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:39.646319 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:39.646291    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74567db5-3977-4daf-9202-8ac4c8c8dc38-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:40.220212 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.220181    5529 generic.go:356] "Generic (PLEG): container finished" podID="74567db5-3977-4daf-9202-8ac4c8c8dc38" containerID="63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb" exitCode=0
Nov 01 04:25:40.220676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.220248    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8" event={"ID":"74567db5-3977-4daf-9202-8ac4c8c8dc38","Type":"ContainerDied","Data":"63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb"}
Nov 01 04:25:40.220676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.220258    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"
Nov 01 04:25:40.220676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.220288    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8" event={"ID":"74567db5-3977-4daf-9202-8ac4c8c8dc38","Type":"ContainerDied","Data":"d222e35b97e301cb7e0b0bc487171d88ff4799137bc4820bccbc0abbd0a2b1b8"}
Nov 01 04:25:40.220676 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.220309    5529 scope.go:122] "RemoveContainer" containerID="63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb"
Nov 01 04:25:40.231068 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.231040    5529 scope.go:122] "RemoveContainer" containerID="63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb"
Nov 01 04:25:40.231514 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:25:40.231387    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb\": container with ID starting with 63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb not found: ID does not exist" containerID="63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb"
Nov 01 04:25:40.231514 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.231425    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb"} err="failed to get container status \"63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb\": rpc error: code = NotFound desc = could not find container \"63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb\": container with ID starting with 63d7502408cab33193711d5e92baa85ae7e6b9d5478aee7ec805633fd15ca2cb not found: ID does not exist"
Nov 01 04:25:40.386950 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.386918    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"]
Nov 01 04:25:40.437602 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.437566    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-praxis-b-862ad1-596c67f8df-g5st8"]
Nov 01 04:25:40.822841 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:40.822809    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:41.119874 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:41.119786    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:41.325039 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:41.325004    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:41.373631 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:41.373609    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74567db5-3977-4daf-9202-8ac4c8c8dc38" path="/var/lib/kubelet/pods/74567db5-3977-4daf-9202-8ac4c8c8dc38/volumes"
Nov 01 04:25:41.802103 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:41.802018    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:44.283403 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:25:44.283368    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:25:46.616580 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:46.616540    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main" containerID="cri-o://df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435" gracePeriod=45
Nov 01 04:25:46.699698 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:46.699659    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:46.783665 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:46.783623    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": dial tcp 10.133.0.55:8000: connect: connection refused"
Nov 01 04:25:46.877688 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:46.877660    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 04:25:47.020436 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.020406    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-tmp-dir\") pod \"98b47b0c-be85-4d9c-b357-81b50aacbacb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") "
Nov 01 04:25:47.020436 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.020450    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-home\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-home\") pod \"98b47b0c-be85-4d9c-b357-81b50aacbacb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") "
Nov 01 04:25:47.020697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.020510    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-model-cache\") pod \"98b47b0c-be85-4d9c-b357-81b50aacbacb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") "
Nov 01 04:25:47.020697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.020533    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98b47b0c-be85-4d9c-b357-81b50aacbacb-tls-certs\" (UniqueName: \"kubernetes.io/secret/98b47b0c-be85-4d9c-b357-81b50aacbacb-tls-certs\") pod \"98b47b0c-be85-4d9c-b357-81b50aacbacb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") "
Nov 01 04:25:47.020697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.020607    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-dshm\") pod \"98b47b0c-be85-4d9c-b357-81b50aacbacb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") "
Nov 01 04:25:47.020858 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.020712    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98b47b0c-be85-4d9c-b357-81b50aacbacb-kube-api-access-24jzn\" (UniqueName: \"kubernetes.io/projected/98b47b0c-be85-4d9c-b357-81b50aacbacb-kube-api-access-24jzn\") pod \"98b47b0c-be85-4d9c-b357-81b50aacbacb\" (UID: \"98b47b0c-be85-4d9c-b357-81b50aacbacb\") "
Nov 01 04:25:47.020858 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.020787    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-tmp-dir" pod "98b47b0c-be85-4d9c-b357-81b50aacbacb" (UID: "98b47b0c-be85-4d9c-b357-81b50aacbacb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:47.021113 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.021082    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-model-cache" pod "98b47b0c-be85-4d9c-b357-81b50aacbacb" (UID: "98b47b0c-be85-4d9c-b357-81b50aacbacb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:47.021205 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.021157    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:47.021285 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.021265    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-home" pod "98b47b0c-be85-4d9c-b357-81b50aacbacb" (UID: "98b47b0c-be85-4d9c-b357-81b50aacbacb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:47.023056 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.023025    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98b47b0c-be85-4d9c-b357-81b50aacbacb-tls-certs" pod "98b47b0c-be85-4d9c-b357-81b50aacbacb" (UID: "98b47b0c-be85-4d9c-b357-81b50aacbacb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:25:47.023238 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.023215    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-dshm" pod "98b47b0c-be85-4d9c-b357-81b50aacbacb" (UID: "98b47b0c-be85-4d9c-b357-81b50aacbacb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:25:47.023324 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.023268    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98b47b0c-be85-4d9c-b357-81b50aacbacb-kube-api-access-24jzn" pod "98b47b0c-be85-4d9c-b357-81b50aacbacb" (UID: "98b47b0c-be85-4d9c-b357-81b50aacbacb"). InnerVolumeSpecName "kube-api-access-24jzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:25:47.122627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.122597    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:47.122627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.122623    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98b47b0c-be85-4d9c-b357-81b50aacbacb-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:47.122627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.122632    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:47.122865 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.122642    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24jzn\" (UniqueName: \"kubernetes.io/projected/98b47b0c-be85-4d9c-b357-81b50aacbacb-kube-api-access-24jzn\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:47.122865 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.122651    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98b47b0c-be85-4d9c-b357-81b50aacbacb-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:25:47.271664 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.271576    5529 generic.go:356] "Generic (PLEG): container finished" podID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerID="df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435" exitCode=0
Nov 01 04:25:47.271664 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.271616    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" event={"ID":"98b47b0c-be85-4d9c-b357-81b50aacbacb","Type":"ContainerDied","Data":"df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435"}
Nov 01 04:25:47.271664 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.271629    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"
Nov 01 04:25:47.271664 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.271643    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb" event={"ID":"98b47b0c-be85-4d9c-b357-81b50aacbacb","Type":"ContainerDied","Data":"1c6f6ac7545335ff5b32cf45d90bbd076a5b1bc32e73cbfbe821becc6d0f9c77"}
Nov 01 04:25:47.271664 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.271663    5529 scope.go:122] "RemoveContainer" containerID="df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435"
Nov 01 04:25:47.282824 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.282802    5529 scope.go:122] "RemoveContainer" containerID="df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435"
Nov 01 04:25:47.283113 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:25:47.283092    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435\": container with ID starting with df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435 not found: ID does not exist" containerID="df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435"
Nov 01 04:25:47.283155 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.283123    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435"} err="failed to get container status \"df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435\": rpc error: code = NotFound desc = could not find container \"df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435\": container with ID starting with df3819323b97c08d1b0f8798997d5004c6e4c00884bca984e7a5ba6dfad4f435 not found: ID does not exist"
Nov 01 04:25:47.438937 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.438900    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"]
Nov 01 04:25:47.443429 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:47.443400    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-f73b9f/premium-w3-f73b9f-kserve-877875bb4-c86xb"]
Nov 01 04:25:48.156411 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:48.156376    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:48.358209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:48.358177    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:48.561540 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:48.561463    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:49.379099 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:49.379063    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" path="/var/lib/kubelet/pods/98b47b0c-be85-4d9c-b357-81b50aacbacb/volumes"
Nov 01 04:25:50.245764 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:50.245732    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:52.043179 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:52.043143    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:55.163386 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:55.163351    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"]
Nov 01 04:25:55.213383 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:55.213345    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"]
Nov 01 04:25:55.360532 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:55.360502    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:25:57.448025 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:25:57.447987    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:00.127016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:00.126975    5529 scope.go:122] "RemoveContainer" containerID="c23580dc4e366e7ac2c2c56263627ef8a95a23251058c8a9b5bfc01f8a572bdd"
Nov 01 04:26:02.563807 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:02.563770    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:02.768616 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:02.768585    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:07.549951 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:07.549902    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:07.750740 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:07.750700    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:07.946788 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:07.946755    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:08.145420 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:08.145386    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:09.546366 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:09.546332    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:09.970249 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:09.970215    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:10.184000 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.183945    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main" containerID="cri-o://2ce6f498f26211e5ea31d6cd483789cf6f6ca84ebf5b4cfceecb97831a99f617" gracePeriod=45
Nov 01 04:26:10.233696 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.233581    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerName="main" containerID="cri-o://0cbbc02a67587c59b6f57c933791dd113bb68958b8bec9d9d6b78f9c3a856845" gracePeriod=45
Nov 01 04:26:10.440716 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.440507    5529 generic.go:356] "Generic (PLEG): container finished" podID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerID="2ce6f498f26211e5ea31d6cd483789cf6f6ca84ebf5b4cfceecb97831a99f617" exitCode=0
Nov 01 04:26:10.440716 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.440653    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" event={"ID":"058a1cb2-3d68-438b-b0dc-b04d8d3da593","Type":"ContainerDied","Data":"2ce6f498f26211e5ea31d6cd483789cf6f6ca84ebf5b4cfceecb97831a99f617"}
Nov 01 04:26:10.442601 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.442451    5529 generic.go:356] "Generic (PLEG): container finished" podID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerID="0cbbc02a67587c59b6f57c933791dd113bb68958b8bec9d9d6b78f9c3a856845" exitCode=0
Nov 01 04:26:10.442601 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.442568    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" event={"ID":"2e801116-8707-43b2-94b7-c10bf6b348ba","Type":"ContainerDied","Data":"0cbbc02a67587c59b6f57c933791dd113bb68958b8bec9d9d6b78f9c3a856845"}
Nov 01 04:26:10.502669 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.502600    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 04:26:10.534435 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.534405    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 04:26:10.575233 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575200    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tls-certs\" (UniqueName: \"kubernetes.io/secret/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tls-certs\") pod \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") "
Nov 01 04:26:10.575645 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575248    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/058a1cb2-3d68-438b-b0dc-b04d8d3da593-kube-api-access-xts82\" (UniqueName: \"kubernetes.io/projected/058a1cb2-3d68-438b-b0dc-b04d8d3da593-kube-api-access-xts82\") pod \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") "
Nov 01 04:26:10.575645 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575393    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-dshm\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-dshm\") pod \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") "
Nov 01 04:26:10.575645 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575424    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tmp-dir\") pod \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") "
Nov 01 04:26:10.575645 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575498    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-model-cache\") pod \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") "
Nov 01 04:26:10.575645 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575531    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-home\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-home\") pod \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\" (UID: \"058a1cb2-3d68-438b-b0dc-b04d8d3da593\") "
Nov 01 04:26:10.575911 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575726    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tmp-dir" pod "058a1cb2-3d68-438b-b0dc-b04d8d3da593" (UID: "058a1cb2-3d68-438b-b0dc-b04d8d3da593"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:26:10.575911 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575799    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-model-cache" pod "058a1cb2-3d68-438b-b0dc-b04d8d3da593" (UID: "058a1cb2-3d68-438b-b0dc-b04d8d3da593"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:26:10.575911 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.575880    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-home" pod "058a1cb2-3d68-438b-b0dc-b04d8d3da593" (UID: "058a1cb2-3d68-438b-b0dc-b04d8d3da593"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:26:10.576086 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.576066    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.576125 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.576093    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.576125 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.576113    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.577940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.577919    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tls-certs" pod "058a1cb2-3d68-438b-b0dc-b04d8d3da593" (UID: "058a1cb2-3d68-438b-b0dc-b04d8d3da593"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:26:10.578091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.578073    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-dshm" pod "058a1cb2-3d68-438b-b0dc-b04d8d3da593" (UID: "058a1cb2-3d68-438b-b0dc-b04d8d3da593"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:26:10.578149 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.578092    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/058a1cb2-3d68-438b-b0dc-b04d8d3da593-kube-api-access-xts82" pod "058a1cb2-3d68-438b-b0dc-b04d8d3da593" (UID: "058a1cb2-3d68-438b-b0dc-b04d8d3da593"). InnerVolumeSpecName "kube-api-access-xts82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:26:10.677277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.677239    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-model-cache\") pod \"2e801116-8707-43b2-94b7-c10bf6b348ba\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") "
Nov 01 04:26:10.677456 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.677363    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-home\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-home\") pod \"2e801116-8707-43b2-94b7-c10bf6b348ba\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") "
Nov 01 04:26:10.677456 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.677415    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e801116-8707-43b2-94b7-c10bf6b348ba-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e801116-8707-43b2-94b7-c10bf6b348ba-tls-certs\") pod \"2e801116-8707-43b2-94b7-c10bf6b348ba\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") "
Nov 01 04:26:10.677595 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.677523    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-model-cache" pod "2e801116-8707-43b2-94b7-c10bf6b348ba" (UID: "2e801116-8707-43b2-94b7-c10bf6b348ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:26:10.677595 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.677550    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e801116-8707-43b2-94b7-c10bf6b348ba-kube-api-access-ncrb4\" (UniqueName: \"kubernetes.io/projected/2e801116-8707-43b2-94b7-c10bf6b348ba-kube-api-access-ncrb4\") pod \"2e801116-8707-43b2-94b7-c10bf6b348ba\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") "
Nov 01 04:26:10.677697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.677600    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-dshm\") pod \"2e801116-8707-43b2-94b7-c10bf6b348ba\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") "
Nov 01 04:26:10.677697 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.677658    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-tmp-dir\") pod \"2e801116-8707-43b2-94b7-c10bf6b348ba\" (UID: \"2e801116-8707-43b2-94b7-c10bf6b348ba\") "
Nov 01 04:26:10.677894 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.677870    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-home" pod "2e801116-8707-43b2-94b7-c10bf6b348ba" (UID: "2e801116-8707-43b2-94b7-c10bf6b348ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:26:10.678142 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.678120    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/058a1cb2-3d68-438b-b0dc-b04d8d3da593-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.678273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.678145    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.678273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.678191    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/058a1cb2-3d68-438b-b0dc-b04d8d3da593-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.678273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.678205    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.678273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.678219    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xts82\" (UniqueName: \"kubernetes.io/projected/058a1cb2-3d68-438b-b0dc-b04d8d3da593-kube-api-access-xts82\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.678502 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.678416    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-tmp-dir" pod "2e801116-8707-43b2-94b7-c10bf6b348ba" (UID: "2e801116-8707-43b2-94b7-c10bf6b348ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:26:10.680090 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.680061    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e801116-8707-43b2-94b7-c10bf6b348ba-kube-api-access-ncrb4" pod "2e801116-8707-43b2-94b7-c10bf6b348ba" (UID: "2e801116-8707-43b2-94b7-c10bf6b348ba"). InnerVolumeSpecName "kube-api-access-ncrb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:26:10.680292 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.680276    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-dshm" pod "2e801116-8707-43b2-94b7-c10bf6b348ba" (UID: "2e801116-8707-43b2-94b7-c10bf6b348ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:26:10.680500 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.680479    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e801116-8707-43b2-94b7-c10bf6b348ba-tls-certs" pod "2e801116-8707-43b2-94b7-c10bf6b348ba" (UID: "2e801116-8707-43b2-94b7-c10bf6b348ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:26:10.779680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.779591    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e801116-8707-43b2-94b7-c10bf6b348ba-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.779680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.779624    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncrb4\" (UniqueName: \"kubernetes.io/projected/2e801116-8707-43b2-94b7-c10bf6b348ba-kube-api-access-ncrb4\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.779680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.779640    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:10.779680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:10.779653    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e801116-8707-43b2-94b7-c10bf6b348ba-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:26:11.377000 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.376963    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:11.450557 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.450532    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"
Nov 01 04:26:11.450557 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.450527    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr" event={"ID":"058a1cb2-3d68-438b-b0dc-b04d8d3da593","Type":"ContainerDied","Data":"5531932a1301c0ab5b7a43af4c99317803150f4da827558b1ef4053ee17b3ae0"}
Nov 01 04:26:11.450801 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.450588    5529 scope.go:122] "RemoveContainer" containerID="2ce6f498f26211e5ea31d6cd483789cf6f6ca84ebf5b4cfceecb97831a99f617"
Nov 01 04:26:11.452636 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.452617    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"
Nov 01 04:26:11.452751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.452660    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk" event={"ID":"2e801116-8707-43b2-94b7-c10bf6b348ba","Type":"ContainerDied","Data":"f9c95c19d0bc470c540946f4d0282d9afed6d6ac710f32e3c61176de0c8600d9"}
Nov 01 04:26:11.461952 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.461932    5529 scope.go:122] "RemoveContainer" containerID="0cbbc02a67587c59b6f57c933791dd113bb68958b8bec9d9d6b78f9c3a856845"
Nov 01 04:26:11.617088 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.617055    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"]
Nov 01 04:26:11.666643 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.666605    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-162191/premium-w0-162191-kserve-5868cd8954-rcktr"]
Nov 01 04:26:11.733030 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.732941    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"]
Nov 01 04:26:11.737149 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.737116    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-162191/simulator-w0-162191-kserve-768796ddd7-jb8rk"]
Nov 01 04:26:11.948460 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:11.948425    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:12.151337 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:12.151301    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:13.028491 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:13.028459    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:13.374688 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:13.374665    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" path="/var/lib/kubelet/pods/058a1cb2-3d68-438b-b0dc-b04d8d3da593/volumes"
Nov 01 04:26:13.375140 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:13.375126    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" path="/var/lib/kubelet/pods/2e801116-8707-43b2-94b7-c10bf6b348ba/volumes"
Nov 01 04:26:14.284898 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:26:14.284858    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:26:15.787467 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:15.787436    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:15.982701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:15.982670    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:16.385559 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:16.385529    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:16.583027 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:16.582987    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:18.137216 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:18.137183    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:18.340099 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:18.340065    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:18.541648 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:18.541551    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:19.620902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:19.620863    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:19.817460 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:19.817423    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:24.037624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:24.037578    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:25.940138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:25.940101    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:26.396936 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:26.396906    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:27.684395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:27.684349    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:28.298958 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:28.298914    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:28.688919 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:28.688867    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:29.820984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:29.820895    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:31.656619 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:31.656571    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:31.915682 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:31.915594    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:32.420895 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:32.420848    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:32.621106 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:32.621074    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:33.375994 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:33.375962    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:35.110763 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:35.110717    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:36.672850 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:36.672809    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:36.878059 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:36.878023    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:39.210343 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:39.210269    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:40.600608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:40.600577    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:44.284803 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:26:44.284768    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:26:45.803528 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:45.803480    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:50.753639 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:50.753599    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:53.977840 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:53.977786    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:54.177510 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:54.177478    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:26:55.712086 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:26:55.712038    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:00.632964 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:00.632927    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:03.175822 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:03.175782    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:05.076100 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:05.076064    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:05.273253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:05.273219    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:05.850441 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:05.850410    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:06.054174 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:06.054135    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:08.802219 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:08.802183    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:09.011895 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:09.011860    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:11.393973 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:11.393930    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:11.979508 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:11.979470    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:12.222609 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:12.222576    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:14.284992 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:27:14.284951    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:27:16.014382 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:16.014308    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:16.211519 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:16.211482    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:17.698868 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:17.698832    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:17.925643 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:17.925601    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:18.232175 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:18.232136    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:18.733274 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:18.733241    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:22.604299 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.604264    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"]
Nov 01 04:27:22.604730 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.604472    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm" podUID="66e52bdd-e5c4-458b-96db-9f6570c3391d" containerName="maas-api" containerID="cri-o://ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5" gracePeriod=30
Nov 01 04:27:22.765040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.765008    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:22.908171 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.908129    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 04:27:22.924107 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.924074    5529 generic.go:356] "Generic (PLEG): container finished" podID="66e52bdd-e5c4-458b-96db-9f6570c3391d" containerID="ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5" exitCode=0
Nov 01 04:27:22.924302 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.924130    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"
Nov 01 04:27:22.924302 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.924159    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm" event={"ID":"66e52bdd-e5c4-458b-96db-9f6570c3391d","Type":"ContainerDied","Data":"ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5"}
Nov 01 04:27:22.924302 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.924245    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm" event={"ID":"66e52bdd-e5c4-458b-96db-9f6570c3391d","Type":"ContainerDied","Data":"70228f25ed68fd7876080b174e6a76712eb022377b3e94996e3656eedf2a36df"}
Nov 01 04:27:22.924417 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.924277    5529 scope.go:122] "RemoveContainer" containerID="ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5"
Nov 01 04:27:22.940004 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.939897    5529 scope.go:122] "RemoveContainer" containerID="ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5"
Nov 01 04:27:22.940768 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:27:22.940688    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5\": container with ID starting with ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5 not found: ID does not exist" containerID="ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5"
Nov 01 04:27:22.940768 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:22.940726    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5"} err="failed to get container status \"ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5\": rpc error: code = NotFound desc = could not find container \"ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5\": container with ID starting with ae72a10a6a05069cb784c8454538a345d59b5d0d0c9d85d6643be8b1a35c23f5 not found: ID does not exist"
Nov 01 04:27:23.066561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.066530    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66e52bdd-e5c4-458b-96db-9f6570c3391d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e52bdd-e5c4-458b-96db-9f6570c3391d-openshift-service-ca\") pod \"66e52bdd-e5c4-458b-96db-9f6570c3391d\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") "
Nov 01 04:27:23.066732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.066583    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-metrics-certs\") pod \"66e52bdd-e5c4-458b-96db-9f6570c3391d\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") "
Nov 01 04:27:23.066732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.066614    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66e52bdd-e5c4-458b-96db-9f6570c3391d-kube-api-access-gknx9\" (UniqueName: \"kubernetes.io/projected/66e52bdd-e5c4-458b-96db-9f6570c3391d-kube-api-access-gknx9\") pod \"66e52bdd-e5c4-458b-96db-9f6570c3391d\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") "
Nov 01 04:27:23.066732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.066690    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls\") pod \"66e52bdd-e5c4-458b-96db-9f6570c3391d\" (UID: \"66e52bdd-e5c4-458b-96db-9f6570c3391d\") "
Nov 01 04:27:23.066992 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.066966    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e52bdd-e5c4-458b-96db-9f6570c3391d-openshift-service-ca" pod "66e52bdd-e5c4-458b-96db-9f6570c3391d" (UID: "66e52bdd-e5c4-458b-96db-9f6570c3391d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:27:23.067082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.067056    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e52bdd-e5c4-458b-96db-9f6570c3391d-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:27:23.068852 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.068827    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls" pod "66e52bdd-e5c4-458b-96db-9f6570c3391d" (UID: "66e52bdd-e5c4-458b-96db-9f6570c3391d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:27:23.068949 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.068875    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e52bdd-e5c4-458b-96db-9f6570c3391d-kube-api-access-gknx9" pod "66e52bdd-e5c4-458b-96db-9f6570c3391d" (UID: "66e52bdd-e5c4-458b-96db-9f6570c3391d"). InnerVolumeSpecName "kube-api-access-gknx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:27:23.068949 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.068884    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-metrics-certs" pod "66e52bdd-e5c4-458b-96db-9f6570c3391d" (UID: "66e52bdd-e5c4-458b-96db-9f6570c3391d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:27:23.168091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.168058    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:27:23.168091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.168086    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/66e52bdd-e5c4-458b-96db-9f6570c3391d-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:27:23.168091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.168097    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gknx9\" (UniqueName: \"kubernetes.io/projected/66e52bdd-e5c4-458b-96db-9f6570c3391d-kube-api-access-gknx9\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:27:23.351506 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.351469    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"]
Nov 01 04:27:23.354002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.353974    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-f73b9f-54d5bbb767-qxnpm"]
Nov 01 04:27:23.374176 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:23.374134    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66e52bdd-e5c4-458b-96db-9f6570c3391d" path="/var/lib/kubelet/pods/66e52bdd-e5c4-458b-96db-9f6570c3391d/volumes"
Nov 01 04:27:24.341817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:24.341771    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:24.581338 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:24.581308    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:24.839881 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:24.839846    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:25.294743 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:25.294712    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:25.500105 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:25.500071    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:25.697924 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:25.697891    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:26.268786 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:26.268752    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:29.805643 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:29.805610    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:30.006563 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:30.006533    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:30.205072 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:30.205041    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:31.129345 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:31.129301    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:31.324853 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:31.324823    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:31.521224 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:31.521113    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:35.017376 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:35.017346    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:40.022423 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:40.022382    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:44.285189 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:27:44.285130    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:27:45.028577 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:45.028542    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:50.010953 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:50.010917    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:54.994348 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:54.994313    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:27:59.801736 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:59.801707    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:27:59.813764 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:59.813740    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:27:59.923256 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:27:59.923217    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:01.238030 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:01.237985    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:04.915568 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:04.915518    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:09.742321 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:09.742220    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:09.937930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:09.937898    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:14.002636 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:14.002600    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:14.284133 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:28:14.284054    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:28:15.263367 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:15.263333    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:16.473138 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:16.473105    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:20.614696 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:20.614658    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:25.613675 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:25.613637    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:26.661538 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:26.661508    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:28.153744 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:28.153640    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:28.351785 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:28.351754    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:30.625194 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:30.625147    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:35.551668 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:35.551633    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:40.419071 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:40.419030    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:40.784546 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:40.784454    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:41.695815 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:41.695783    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:44.285072 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:28:44.285029    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:28:45.805863 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.805828    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"]
Nov 01 04:28:45.806311 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806297    5529 cpu_manager.go:414] "containerMap: removing container" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main"
Nov 01 04:28:45.806311 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806311    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806326    5529 cpu_manager.go:414] "containerMap: removing container" podUID="8dc85899-cb25-4bc3-a620-a9d5ea360654" containerName="payload-processing"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806331    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8dc85899-cb25-4bc3-a620-a9d5ea360654" containerName="payload-processing"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806340    5529 cpu_manager.go:414] "containerMap: removing container" podUID="96138547-d4dd-450b-8b63-92753452d3bb" containerName="maas-api"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806345    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96138547-d4dd-450b-8b63-92753452d3bb" containerName="maas-api"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806352    5529 cpu_manager.go:414] "containerMap: removing container" podUID="3881b824-3057-400c-a35f-35a71dda6f43" containerName="maas-api"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806356    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3881b824-3057-400c-a35f-35a71dda6f43" containerName="maas-api"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806365    5529 cpu_manager.go:414] "containerMap: removing container" podUID="1ff51bec-fa78-4201-9718-1605b17c6ba4" containerName="payload-pre-processing"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806371    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff51bec-fa78-4201-9718-1605b17c6ba4" containerName="payload-pre-processing"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806381    5529 cpu_manager.go:414] "containerMap: removing container" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806385    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy"
Nov 01 04:28:45.806390 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806392    5529 cpu_manager.go:414] "containerMap: removing container" podUID="386d19de-8a52-4288-885a-bc1c99cc71d9" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806397    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="386d19de-8a52-4288-885a-bc1c99cc71d9" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806403    5529 cpu_manager.go:414] "containerMap: removing container" podUID="c9425546-ab4d-4088-9b74-4f744cbbd8ca" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806407    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c9425546-ab4d-4088-9b74-4f744cbbd8ca" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806421    5529 cpu_manager.go:414] "containerMap: removing container" podUID="a0c7daf5-033c-4d12-81ac-1ae555cc6fa1" containerName="payload-pre-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806426    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0c7daf5-033c-4d12-81ac-1ae555cc6fa1" containerName="payload-pre-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806434    5529 cpu_manager.go:414] "containerMap: removing container" podUID="962b62e4-012a-428f-817f-8e23bb401747" containerName="payload-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806438    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="962b62e4-012a-428f-817f-8e23bb401747" containerName="payload-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806461    5529 cpu_manager.go:414] "containerMap: removing container" podUID="66e52bdd-e5c4-458b-96db-9f6570c3391d" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806466    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66e52bdd-e5c4-458b-96db-9f6570c3391d" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806473    5529 cpu_manager.go:414] "containerMap: removing container" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806477    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806486    5529 cpu_manager.go:414] "containerMap: removing container" podUID="dc28cc2c-c119-4f2d-8f4e-ea328585c311" containerName="payload-pre-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806490    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc28cc2c-c119-4f2d-8f4e-ea328585c311" containerName="payload-pre-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806504    5529 cpu_manager.go:414] "containerMap: removing container" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerName="main"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806509    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerName="main"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806516    5529 cpu_manager.go:414] "containerMap: removing container" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806522    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806528    5529 cpu_manager.go:414] "containerMap: removing container" podUID="74567db5-3977-4daf-9202-8ac4c8c8dc38" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806532    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74567db5-3977-4daf-9202-8ac4c8c8dc38" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806541    5529 cpu_manager.go:414] "containerMap: removing container" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806546    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806609    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0c7daf5-033c-4d12-81ac-1ae555cc6fa1" containerName="payload-pre-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806618    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="962b62e4-012a-428f-817f-8e23bb401747" containerName="payload-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806625    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="66e52bdd-e5c4-458b-96db-9f6570c3391d" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806630    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="44dfbaba-e6c6-42c1-9370-0af412e38f2f" containerName="istio-proxy"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806637    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc28cc2c-c119-4f2d-8f4e-ea328585c311" containerName="payload-pre-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806644    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e801116-8707-43b2-94b7-c10bf6b348ba" containerName="main"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806650    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="058a1cb2-3d68-438b-b0dc-b04d8d3da593" containerName="main"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806656    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="74567db5-3977-4daf-9202-8ac4c8c8dc38" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806662    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="99f7bc02-66fe-43d2-abaf-e5bd85d256ef" containerName="istio-proxy"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806668    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="98b47b0c-be85-4d9c-b357-81b50aacbacb" containerName="main"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806674    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="8dc85899-cb25-4bc3-a620-a9d5ea360654" containerName="payload-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806679    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="96138547-d4dd-450b-8b63-92753452d3bb" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806683    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="3881b824-3057-400c-a35f-35a71dda6f43" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806688    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff51bec-fa78-4201-9718-1605b17c6ba4" containerName="payload-pre-processing"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806693    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="226ba30c-9da4-4067-ba55-0a030c13a7d4" containerName="istio-proxy"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806697    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="386d19de-8a52-4288-885a-bc1c99cc71d9" containerName="maas-api"
Nov 01 04:28:45.806733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.806702    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="c9425546-ab4d-4088-9b74-4f744cbbd8ca" containerName="maas-api"
Nov 01 04:28:45.810414 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.810392    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.839388 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.839352    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-model-cache\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.839586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.839406    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tls-certs\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.839586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.839443    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m54rd\" (UniqueName: \"kubernetes.io/projected/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-kube-api-access-m54rd\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.839586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.839466    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-home\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.839586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.839480    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tmp-dir\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.839586 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.839549    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-dshm\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.863759 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.863720    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-praxis-a-ad9e22\"/\"openshift-service-ca.crt\""
Nov 01 04:28:45.896564 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.896531    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:45.913885 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.913847    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-praxis-a-ad9e22\"/\"praxis-route-ad9e22-kserve-self-signed-certs\""
Nov 01 04:28:45.913885 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.913866    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-praxis-a-ad9e22\"/\"kube-root-ca.crt\""
Nov 01 04:28:45.914107 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.913879    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-praxis-a-ad9e22\"/\"default-dockercfg-msplq\""
Nov 01 04:28:45.918461 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.918424    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"]
Nov 01 04:28:45.940400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940369    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-model-cache\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.940561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940408    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tls-certs\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.940561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940432    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m54rd\" (UniqueName: \"kubernetes.io/projected/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-kube-api-access-m54rd\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.940561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940454    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-home\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.940561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940468    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tmp-dir\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.940561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940528    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-dshm\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.940821 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940794    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-model-cache\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.940884 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940825    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-home\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.940884 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.940868    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tmp-dir\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.942864 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.942836    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-dshm\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:45.943020 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:45.943002    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tls-certs\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:46.002217 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:46.002184    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m54rd\" (UniqueName: \"kubernetes.io/projected/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-kube-api-access-m54rd\") pod \"praxis-route-ad9e22-kserve-cd96bdb59-wmdpf\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") " pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:46.096120 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:46.096043    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:46.125052 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:46.125016    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:46.513398 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:46.513371    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"]
Nov 01 04:28:46.515821 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:28:46.515795    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4adbbde8_f3b5_4f17_8d75_dbe3c80b1948.slice/crio-eb7237612f8354ea6e93f21200bb660c9cec5c812c08670d8071a996ba993d38 WatchSource:0}: Error finding container eb7237612f8354ea6e93f21200bb660c9cec5c812c08670d8071a996ba993d38: Status 404 returned error can't find the container with id eb7237612f8354ea6e93f21200bb660c9cec5c812c08670d8071a996ba993d38
Nov 01 04:28:47.466931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:47.466895    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf" event={"ID":"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948","Type":"ContainerStarted","Data":"a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c"}
Nov 01 04:28:47.467389 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:47.466938    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf" event={"ID":"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948","Type":"ContainerStarted","Data":"eb7237612f8354ea6e93f21200bb660c9cec5c812c08670d8071a996ba993d38"}
Nov 01 04:28:47.585840 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:47.585785    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf" podStartSLOduration=2.585772236 podStartE2EDuration="2.585772236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:28:47.583643636 +0000 UTC m=+2748.343371431" watchObservedRunningTime="2026-11-01 04:28:47.585772236 +0000 UTC m=+2748.345500030"
Nov 01 04:28:48.125193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:48.125152    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:50.267227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:50.267196    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:51.861493 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:51.861462    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:52.114943 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:52.114827    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:52.403404 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:52.403372    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:52.882931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:52.882900    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:28:56.125484 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:56.125442    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:56.138726 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:56.138696    5529 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:56.538748 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:56.538663    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:28:57.420421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:28:57.420384    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:00.352247 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:00.352204    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:00.559033 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:00.558997    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:02.791758 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:02.791725    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:08.144223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:08.144180    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:12.247370 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:12.247333    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:12.446259 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:12.446221    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:13.313729 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:13.313695    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:14.283971 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:29:14.283936    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:29:16.752814 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:16.752773    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:16.949342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:16.949305    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:18.601778 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:18.601705    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:23.979217 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:23.979177    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:26.824899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:26.824865    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:27.021234 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:27.021190    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:29.298963 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:29.298931    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:29.859878 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:29.859832    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:30.930577 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:30.930542    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:31.125045 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:31.124997    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:34.292366 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:34.292291    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:35.930409 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:35.930373    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:36.129367 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:36.129332    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:39.222431 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:39.222317    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:44.193518 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:44.193485    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:44.284212 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:29:44.284158    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:29:48.515223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:48.515185    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:50.094373 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:50.094340    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:50.327520 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:50.327487    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:50.526491 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:50.526457    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:51.014669 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:51.014608    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:54.902929 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:54.902894    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:56.512229 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:56.512193    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:56.808912 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:56.808820    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:57.027273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:57.027058    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:57.224948 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:57.224916    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:29:57.432894 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:29:57.432859    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:00.206701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.206668    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"]
Nov 01 04:30:00.210706 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.210682    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:00.263495 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.263457    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6ggdg\""
Nov 01 04:30:00.320050 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.320013    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"]
Nov 01 04:30:00.339103 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.339063    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8585ec-6d27-43ee-93c6-134c1b2df31f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz\" (UID: \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:00.339322 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.339150    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2fks\" (UniqueName: \"kubernetes.io/projected/3f8585ec-6d27-43ee-93c6-134c1b2df31f-kube-api-access-p2fks\") pod \"maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz\" (UID: \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:00.440013 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.439968    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8585ec-6d27-43ee-93c6-134c1b2df31f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz\" (UID: \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:00.440238 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.440059    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2fks\" (UniqueName: \"kubernetes.io/projected/3f8585ec-6d27-43ee-93c6-134c1b2df31f-kube-api-access-p2fks\") pod \"maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz\" (UID: \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:00.440767 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.440741    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8585ec-6d27-43ee-93c6-134c1b2df31f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz\" (UID: \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:00.501579 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.501503    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2fks\" (UniqueName: \"kubernetes.io/projected/3f8585ec-6d27-43ee-93c6-134c1b2df31f-kube-api-access-p2fks\") pod \"maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz\" (UID: \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:00.524595 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.524560    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:00.902830 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:00.902769    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"]
Nov 01 04:30:00.905623 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:30:00.905591    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8585ec_6d27_43ee_93c6_134c1b2df31f.slice/crio-556ede7f8db02d12cb318476312b52d40c91ed97934288d8f5b271ed72b6cebe WatchSource:0}: Error finding container 556ede7f8db02d12cb318476312b52d40c91ed97934288d8f5b271ed72b6cebe: Status 404 returned error can't find the container with id 556ede7f8db02d12cb318476312b52d40c91ed97934288d8f5b271ed72b6cebe
Nov 01 04:30:01.910632 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:01.910601    5529 generic.go:356] "Generic (PLEG): container finished" podID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerID="3288b094aa096b7228e71ee5811b0de1acfc29d5651886eac52a34a7a1fbcee7" exitCode=60
Nov 01 04:30:01.911039 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:01.910637    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" event={"ID":"3f8585ec-6d27-43ee-93c6-134c1b2df31f","Type":"ContainerDied","Data":"3288b094aa096b7228e71ee5811b0de1acfc29d5651886eac52a34a7a1fbcee7"}
Nov 01 04:30:01.911039 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:01.910709    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" event={"ID":"3f8585ec-6d27-43ee-93c6-134c1b2df31f","Type":"ContainerStarted","Data":"556ede7f8db02d12cb318476312b52d40c91ed97934288d8f5b271ed72b6cebe"}
Nov 01 04:30:01.911039 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:01.910932    5529 scope.go:122] "RemoveContainer" containerID="3288b094aa096b7228e71ee5811b0de1acfc29d5651886eac52a34a7a1fbcee7"
Nov 01 04:30:02.108527 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.108447    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:02.428835 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.428797    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"]
Nov 01 04:30:02.432899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.432875    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.485769 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.485734    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 01 04:30:02.487461 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.487431    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"]
Nov 01 04:30:02.562290 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.562254    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/631fedf5-539d-4417-a412-c053e045d00f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.562290 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.562294    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h79kh\" (UniqueName: \"kubernetes.io/projected/631fedf5-539d-4417-a412-c053e045d00f-kube-api-access-h79kh\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.562552 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.562394    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/631fedf5-539d-4417-a412-c053e045d00f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.663508 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.663477    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/631fedf5-539d-4417-a412-c053e045d00f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.663508 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.663510    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h79kh\" (UniqueName: \"kubernetes.io/projected/631fedf5-539d-4417-a412-c053e045d00f-kube-api-access-h79kh\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.663760 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.663545    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/631fedf5-539d-4417-a412-c053e045d00f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.664353 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.664326    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/631fedf5-539d-4417-a412-c053e045d00f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.665989 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.665969    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/631fedf5-539d-4417-a412-c053e045d00f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.724715 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.724638    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h79kh\" (UniqueName: \"kubernetes.io/projected/631fedf5-539d-4417-a412-c053e045d00f-kube-api-access-h79kh\") pod \"maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.746508 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.746477    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:02.919863 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.919827    5529 generic.go:356] "Generic (PLEG): container finished" podID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerID="0bfc8a61111ad5fc55f8755024db6b154c95a6c4ce428c2174839128c458c064" exitCode=60
Nov 01 04:30:02.920392 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.919910    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" event={"ID":"3f8585ec-6d27-43ee-93c6-134c1b2df31f","Type":"ContainerDied","Data":"0bfc8a61111ad5fc55f8755024db6b154c95a6c4ce428c2174839128c458c064"}
Nov 01 04:30:02.920392 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.919975    5529 scope.go:122] "RemoveContainer" containerID="3288b094aa096b7228e71ee5811b0de1acfc29d5651886eac52a34a7a1fbcee7"
Nov 01 04:30:02.920392 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:02.920296    5529 scope.go:122] "RemoveContainer" containerID="0bfc8a61111ad5fc55f8755024db6b154c95a6c4ce428c2174839128c458c064"
Nov 01 04:30:02.920624 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:30:02.920599    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz_odh-ai-gateway-infra(3f8585ec-6d27-43ee-93c6-134c1b2df31f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f"
Nov 01 04:30:03.152911 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:03.152889    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"]
Nov 01 04:30:03.155891 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:30:03.155861    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631fedf5_539d_4417_a412_c053e045d00f.slice/crio-8e27047afd24f9f7e7936f1b6ee2a0ce51daa65838f3693f077d3f4284abd91e WatchSource:0}: Error finding container 8e27047afd24f9f7e7936f1b6ee2a0ce51daa65838f3693f077d3f4284abd91e: Status 404 returned error can't find the container with id 8e27047afd24f9f7e7936f1b6ee2a0ce51daa65838f3693f077d3f4284abd91e
Nov 01 04:30:03.928311 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:03.928273    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l" event={"ID":"631fedf5-539d-4417-a412-c053e045d00f","Type":"ContainerStarted","Data":"63ce9b8e4e83895877fe0f95438a1b7a59bcaff212cd8b6f2ae4bad2e49d8197"}
Nov 01 04:30:03.928799 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:03.928338    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l" event={"ID":"631fedf5-539d-4417-a412-c053e045d00f","Type":"ContainerStarted","Data":"8e27047afd24f9f7e7936f1b6ee2a0ce51daa65838f3693f077d3f4284abd91e"}
Nov 01 04:30:03.930766 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:03.930740    5529 scope.go:122] "RemoveContainer" containerID="0bfc8a61111ad5fc55f8755024db6b154c95a6c4ce428c2174839128c458c064"
Nov 01 04:30:03.931061 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:30:03.931021    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz_odh-ai-gateway-infra(3f8585ec-6d27-43ee-93c6-134c1b2df31f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f"
Nov 01 04:30:04.044886 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:04.044828    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l" podStartSLOduration=2.044809861 podStartE2EDuration="2.044809861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:30:04.043730862 +0000 UTC m=+2824.803458656" watchObservedRunningTime="2026-11-01 04:30:04.044809861 +0000 UTC m=+2824.804537658"
Nov 01 04:30:04.098768 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:04.098721    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:04.296475 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:04.296366    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:04.494721 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:04.494692    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:04.891197 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:04.891152    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:04.938309 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:04.938273    5529 generic.go:356] "Generic (PLEG): container finished" podID="631fedf5-539d-4417-a412-c053e045d00f" containerID="63ce9b8e4e83895877fe0f95438a1b7a59bcaff212cd8b6f2ae4bad2e49d8197" exitCode=0
Nov 01 04:30:04.938716 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:04.938362    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l" event={"ID":"631fedf5-539d-4417-a412-c053e045d00f","Type":"ContainerDied","Data":"63ce9b8e4e83895877fe0f95438a1b7a59bcaff212cd8b6f2ae4bad2e49d8197"}
Nov 01 04:30:06.092346 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.092318    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:06.200608 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.200522    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/631fedf5-539d-4417-a412-c053e045d00f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/631fedf5-539d-4417-a412-c053e045d00f-maas-api-xks-ca\") pod \"631fedf5-539d-4417-a412-c053e045d00f\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") "
Nov 01 04:30:06.200755 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.200625    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/631fedf5-539d-4417-a412-c053e045d00f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/631fedf5-539d-4417-a412-c053e045d00f-maas-api-openshift-ca\") pod \"631fedf5-539d-4417-a412-c053e045d00f\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") "
Nov 01 04:30:06.200755 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.200688    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/631fedf5-539d-4417-a412-c053e045d00f-kube-api-access-h79kh\" (UniqueName: \"kubernetes.io/projected/631fedf5-539d-4417-a412-c053e045d00f-kube-api-access-h79kh\") pod \"631fedf5-539d-4417-a412-c053e045d00f\" (UID: \"631fedf5-539d-4417-a412-c053e045d00f\") "
Nov 01 04:30:06.201009 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.200982    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/631fedf5-539d-4417-a412-c053e045d00f-maas-api-openshift-ca" pod "631fedf5-539d-4417-a412-c053e045d00f" (UID: "631fedf5-539d-4417-a412-c053e045d00f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:30:06.202705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.202672    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/631fedf5-539d-4417-a412-c053e045d00f-maas-api-xks-ca" pod "631fedf5-539d-4417-a412-c053e045d00f" (UID: "631fedf5-539d-4417-a412-c053e045d00f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:30:06.202801 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.202730    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/631fedf5-539d-4417-a412-c053e045d00f-kube-api-access-h79kh" pod "631fedf5-539d-4417-a412-c053e045d00f" (UID: "631fedf5-539d-4417-a412-c053e045d00f"). InnerVolumeSpecName "kube-api-access-h79kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:30:06.302505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.302470    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h79kh\" (UniqueName: \"kubernetes.io/projected/631fedf5-539d-4417-a412-c053e045d00f-kube-api-access-h79kh\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:06.302505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.302504    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/631fedf5-539d-4417-a412-c053e045d00f-maas-api-xks-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:06.302726 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.302514    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/631fedf5-539d-4417-a412-c053e045d00f-maas-api-openshift-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:06.953649 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.953612    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l" event={"ID":"631fedf5-539d-4417-a412-c053e045d00f","Type":"ContainerDied","Data":"8e27047afd24f9f7e7936f1b6ee2a0ce51daa65838f3693f077d3f4284abd91e"}
Nov 01 04:30:06.953867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.953674    5529 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e27047afd24f9f7e7936f1b6ee2a0ce51daa65838f3693f077d3f4284abd91e"
Nov 01 04:30:06.953867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:06.953624    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"
Nov 01 04:30:07.633727 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:07.633689    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:09.800569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:09.800522    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"]
Nov 01 04:30:09.852117 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:09.852081    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"]
Nov 01 04:30:09.855810 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:09.855779    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"]
Nov 01 04:30:09.950460 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:09.950422    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:13.019297 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:13.019258    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:14.219249 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:14.219211    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:14.284414 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:30:14.284376    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:30:14.415861 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:14.415831    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:16.197337 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:16.197292    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"]
Nov 01 04:30:16.592227 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:16.592102    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:16.790986 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:16.790959    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:17.175407 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:17.175371    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:17.375120 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:17.375089    5529 scope.go:122] "RemoveContainer" containerID="0bfc8a61111ad5fc55f8755024db6b154c95a6c4ce428c2174839128c458c064"
Nov 01 04:30:18.015781 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:18.015750    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:18.033523 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:18.033487    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" event={"ID":"3f8585ec-6d27-43ee-93c6-134c1b2df31f","Type":"ContainerStarted","Data":"ec336db11ef9ab74c73288309f120d7c203e4c7c3d4f60231e6450ab1f41a04d"}
Nov 01 04:30:18.150507 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:18.150456    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" podStartSLOduration=18.150432855 podStartE2EDuration="18.150432855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:30:18.149391401 +0000 UTC m=+2838.909119196" watchObservedRunningTime="2026-11-01 04:30:18.150432855 +0000 UTC m=+2838.910160650"
Nov 01 04:30:18.877728 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:18.877678    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:19.042612 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:19.042579    5529 generic.go:356] "Generic (PLEG): container finished" podID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerID="ec336db11ef9ab74c73288309f120d7c203e4c7c3d4f60231e6450ab1f41a04d" exitCode=60
Nov 01 04:30:19.042832 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:19.042655    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" event={"ID":"3f8585ec-6d27-43ee-93c6-134c1b2df31f","Type":"ContainerDied","Data":"ec336db11ef9ab74c73288309f120d7c203e4c7c3d4f60231e6450ab1f41a04d"}
Nov 01 04:30:19.042832 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:19.042717    5529 scope.go:122] "RemoveContainer" containerID="0bfc8a61111ad5fc55f8755024db6b154c95a6c4ce428c2174839128c458c064"
Nov 01 04:30:19.043041 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:19.043024    5529 scope.go:122] "RemoveContainer" containerID="ec336db11ef9ab74c73288309f120d7c203e4c7c3d4f60231e6450ab1f41a04d"
Nov 01 04:30:19.043340 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:30:19.043320    5529 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz_odh-ai-gateway-infra(3f8585ec-6d27-43ee-93c6-134c1b2df31f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f"
Nov 01 04:30:19.080309 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:19.080274    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:19.160062 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:19.159981    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"]
Nov 01 04:30:20.196149 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:20.196122    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:20.349070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:20.348974    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f8585ec-6d27-43ee-93c6-134c1b2df31f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8585ec-6d27-43ee-93c6-134c1b2df31f-maas-api-service-ca\") pod \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\" (UID: \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\") "
Nov 01 04:30:20.349070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:20.349035    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f8585ec-6d27-43ee-93c6-134c1b2df31f-kube-api-access-p2fks\" (UniqueName: \"kubernetes.io/projected/3f8585ec-6d27-43ee-93c6-134c1b2df31f-kube-api-access-p2fks\") pod \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\" (UID: \"3f8585ec-6d27-43ee-93c6-134c1b2df31f\") "
Nov 01 04:30:20.349443 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:20.349418    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f8585ec-6d27-43ee-93c6-134c1b2df31f-maas-api-service-ca" pod "3f8585ec-6d27-43ee-93c6-134c1b2df31f" (UID: "3f8585ec-6d27-43ee-93c6-134c1b2df31f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:30:20.351285 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:20.351259    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f8585ec-6d27-43ee-93c6-134c1b2df31f-kube-api-access-p2fks" pod "3f8585ec-6d27-43ee-93c6-134c1b2df31f" (UID: "3f8585ec-6d27-43ee-93c6-134c1b2df31f"). InnerVolumeSpecName "kube-api-access-p2fks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:30:20.450756 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:20.450717    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f8585ec-6d27-43ee-93c6-134c1b2df31f-maas-api-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:20.450756 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:20.450750    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2fks\" (UniqueName: \"kubernetes.io/projected/3f8585ec-6d27-43ee-93c6-134c1b2df31f-kube-api-access-p2fks\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:21.059108 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:21.059069    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz" event={"ID":"3f8585ec-6d27-43ee-93c6-134c1b2df31f","Type":"ContainerDied","Data":"556ede7f8db02d12cb318476312b52d40c91ed97934288d8f5b271ed72b6cebe"}
Nov 01 04:30:21.059108 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:21.059104    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"
Nov 01 04:30:21.059415 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:21.059132    5529 scope.go:122] "RemoveContainer" containerID="ec336db11ef9ab74c73288309f120d7c203e4c7c3d4f60231e6450ab1f41a04d"
Nov 01 04:30:21.197682 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:21.197627    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg" podUID="2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" containerName="payload-processing" containerID="cri-o://362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae" gracePeriod=25
Nov 01 04:30:21.224877 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:21.224815    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"]
Nov 01 04:30:21.274964 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:21.274932    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-praxis-a-ad9e22-29891790-j67rz"]
Nov 01 04:30:21.372488 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:21.372406    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" path="/var/lib/kubelet/pods/3f8585ec-6d27-43ee-93c6-134c1b2df31f/volumes"
Nov 01 04:30:23.001931 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:23.001901    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:24.821446 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:24.821408    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" podUID="9ece915b-a3f4-4895-a369-f92415229cde" containerName="main" containerID="cri-o://5c846883cf921fead62dc3a5d382b79e76d575ad5aef2112fa409ae8d997f2b5" gracePeriod=45
Nov 01 04:30:24.872503 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:24.872461    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main" containerID="cri-o://340250e92ad0fac9460c0d93d25e8ddcbc504e3d5aecc91d815afc9fb855d4a4" gracePeriod=45
Nov 01 04:30:24.874721 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:24.874685    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerName="main" containerID="cri-o://42fe357b626d071e52c286af792c6161dda5151907f06b2ea5e8e07300e95c0e" gracePeriod=45
Nov 01 04:30:25.088447 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.088361    5529 generic.go:356] "Generic (PLEG): container finished" podID="9ece915b-a3f4-4895-a369-f92415229cde" containerID="5c846883cf921fead62dc3a5d382b79e76d575ad5aef2112fa409ae8d997f2b5" exitCode=0
Nov 01 04:30:25.088609 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.088462    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" event={"ID":"9ece915b-a3f4-4895-a369-f92415229cde","Type":"ContainerDied","Data":"5c846883cf921fead62dc3a5d382b79e76d575ad5aef2112fa409ae8d997f2b5"}
Nov 01 04:30:25.090355 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.090329    5529 generic.go:356] "Generic (PLEG): container finished" podID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerID="340250e92ad0fac9460c0d93d25e8ddcbc504e3d5aecc91d815afc9fb855d4a4" exitCode=0
Nov 01 04:30:25.090498 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.090406    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" event={"ID":"f56100d9-ce5d-4755-bf06-5911d7d0d221","Type":"ContainerDied","Data":"340250e92ad0fac9460c0d93d25e8ddcbc504e3d5aecc91d815afc9fb855d4a4"}
Nov 01 04:30:25.092288 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.092266    5529 generic.go:356] "Generic (PLEG): container finished" podID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerID="42fe357b626d071e52c286af792c6161dda5151907f06b2ea5e8e07300e95c0e" exitCode=0
Nov 01 04:30:25.092404 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.092346    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" event={"ID":"f12a8a8a-d0d8-4753-a64d-b005d2d10943","Type":"ContainerDied","Data":"42fe357b626d071e52c286af792c6161dda5151907f06b2ea5e8e07300e95c0e"}
Nov 01 04:30:25.166223 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.166143    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:30:25.172131 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.172105    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 04:30:25.179217 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.179198    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 04:30:25.198299 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198276    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-tmp-dir\") pod \"f56100d9-ce5d-4755-bf06-5911d7d0d221\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") "
Nov 01 04:30:25.198400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198311    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f12a8a8a-d0d8-4753-a64d-b005d2d10943-kube-api-access-f72s7\" (UniqueName: \"kubernetes.io/projected/f12a8a8a-d0d8-4753-a64d-b005d2d10943-kube-api-access-f72s7\") pod \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") "
Nov 01 04:30:25.198400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198345    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ece915b-a3f4-4895-a369-f92415229cde-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ece915b-a3f4-4895-a369-f92415229cde-tls-certs\") pod \"9ece915b-a3f4-4895-a369-f92415229cde\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") "
Nov 01 04:30:25.198400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198374    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-home\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-home\") pod \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") "
Nov 01 04:30:25.198551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198402    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-model-cache\") pod \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") "
Nov 01 04:30:25.198551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198440    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-dshm\") pod \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") "
Nov 01 04:30:25.198551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198467    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-model-cache\") pod \"9ece915b-a3f4-4895-a369-f92415229cde\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") "
Nov 01 04:30:25.198551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198509    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-model-cache\") pod \"f56100d9-ce5d-4755-bf06-5911d7d0d221\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") "
Nov 01 04:30:25.198551 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198540    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-home\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-home\") pod \"f56100d9-ce5d-4755-bf06-5911d7d0d221\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") "
Nov 01 04:30:25.198804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198567    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-home\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-home\") pod \"9ece915b-a3f4-4895-a369-f92415229cde\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") "
Nov 01 04:30:25.198804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198617    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tmp-dir\") pod \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") "
Nov 01 04:30:25.198804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198646    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ece915b-a3f4-4895-a369-f92415229cde-kube-api-access-2mlg2\" (UniqueName: \"kubernetes.io/projected/9ece915b-a3f4-4895-a369-f92415229cde-kube-api-access-2mlg2\") pod \"9ece915b-a3f4-4895-a369-f92415229cde\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") "
Nov 01 04:30:25.198804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198686    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f56100d9-ce5d-4755-bf06-5911d7d0d221-kube-api-access-7hjd6\" (UniqueName: \"kubernetes.io/projected/f56100d9-ce5d-4755-bf06-5911d7d0d221-kube-api-access-7hjd6\") pod \"f56100d9-ce5d-4755-bf06-5911d7d0d221\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") "
Nov 01 04:30:25.198804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198692    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-home" pod "f12a8a8a-d0d8-4753-a64d-b005d2d10943" (UID: "f12a8a8a-d0d8-4753-a64d-b005d2d10943"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.198804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198709    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-model-cache" pod "f12a8a8a-d0d8-4753-a64d-b005d2d10943" (UID: "f12a8a8a-d0d8-4753-a64d-b005d2d10943"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.198804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198743    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-model-cache" pod "9ece915b-a3f4-4895-a369-f92415229cde" (UID: "9ece915b-a3f4-4895-a369-f92415229cde"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.198804 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198752    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tls-certs\" (UniqueName: \"kubernetes.io/secret/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tls-certs\") pod \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\" (UID: \"f12a8a8a-d0d8-4753-a64d-b005d2d10943\") "
Nov 01 04:30:25.199248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198833    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f56100d9-ce5d-4755-bf06-5911d7d0d221-tls-certs\" (UniqueName: \"kubernetes.io/secret/f56100d9-ce5d-4755-bf06-5911d7d0d221-tls-certs\") pod \"f56100d9-ce5d-4755-bf06-5911d7d0d221\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") "
Nov 01 04:30:25.199248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198894    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-tmp-dir\") pod \"9ece915b-a3f4-4895-a369-f92415229cde\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") "
Nov 01 04:30:25.199248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198931    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-dshm\") pod \"9ece915b-a3f4-4895-a369-f92415229cde\" (UID: \"9ece915b-a3f4-4895-a369-f92415229cde\") "
Nov 01 04:30:25.199248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198934    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-model-cache" pod "f56100d9-ce5d-4755-bf06-5911d7d0d221" (UID: "f56100d9-ce5d-4755-bf06-5911d7d0d221"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.199248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.198940    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-home" pod "9ece915b-a3f4-4895-a369-f92415229cde" (UID: "9ece915b-a3f4-4895-a369-f92415229cde"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.199248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199017    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-dshm\") pod \"f56100d9-ce5d-4755-bf06-5911d7d0d221\" (UID: \"f56100d9-ce5d-4755-bf06-5911d7d0d221\") "
Nov 01 04:30:25.199248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199243    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-tmp-dir" pod "f56100d9-ce5d-4755-bf06-5911d7d0d221" (UID: "f56100d9-ce5d-4755-bf06-5911d7d0d221"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.199617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199482    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tmp-dir" pod "f12a8a8a-d0d8-4753-a64d-b005d2d10943" (UID: "f12a8a8a-d0d8-4753-a64d-b005d2d10943"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.199617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199499    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.199617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199519    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.199617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199534    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.199617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199549    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.199617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199563    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.199617 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199576    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.200008 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.199690    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-home" pod "f56100d9-ce5d-4755-bf06-5911d7d0d221" (UID: "f56100d9-ce5d-4755-bf06-5911d7d0d221"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.201282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201258    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ece915b-a3f4-4895-a369-f92415229cde-kube-api-access-2mlg2" pod "9ece915b-a3f4-4895-a369-f92415229cde" (UID: "9ece915b-a3f4-4895-a369-f92415229cde"). InnerVolumeSpecName "kube-api-access-2mlg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:30:25.201471 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201447    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ece915b-a3f4-4895-a369-f92415229cde-tls-certs" pod "9ece915b-a3f4-4895-a369-f92415229cde" (UID: "9ece915b-a3f4-4895-a369-f92415229cde"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:30:25.201558 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201471    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tls-certs" pod "f12a8a8a-d0d8-4753-a64d-b005d2d10943" (UID: "f12a8a8a-d0d8-4753-a64d-b005d2d10943"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:30:25.201635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201609    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-dshm" pod "f12a8a8a-d0d8-4753-a64d-b005d2d10943" (UID: "f12a8a8a-d0d8-4753-a64d-b005d2d10943"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.201699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201671    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-tmp-dir" pod "9ece915b-a3f4-4895-a369-f92415229cde" (UID: "9ece915b-a3f4-4895-a369-f92415229cde"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.201792 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201773    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-dshm" pod "f56100d9-ce5d-4755-bf06-5911d7d0d221" (UID: "f56100d9-ce5d-4755-bf06-5911d7d0d221"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.201867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201779    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f12a8a8a-d0d8-4753-a64d-b005d2d10943-kube-api-access-f72s7" pod "f12a8a8a-d0d8-4753-a64d-b005d2d10943" (UID: "f12a8a8a-d0d8-4753-a64d-b005d2d10943"). InnerVolumeSpecName "kube-api-access-f72s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:30:25.201867 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201832    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-dshm" pod "9ece915b-a3f4-4895-a369-f92415229cde" (UID: "9ece915b-a3f4-4895-a369-f92415229cde"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:30:25.201993 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.201974    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f56100d9-ce5d-4755-bf06-5911d7d0d221-tls-certs" pod "f56100d9-ce5d-4755-bf06-5911d7d0d221" (UID: "f56100d9-ce5d-4755-bf06-5911d7d0d221"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:30:25.203014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.202997    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f56100d9-ce5d-4755-bf06-5911d7d0d221-kube-api-access-7hjd6" pod "f56100d9-ce5d-4755-bf06-5911d7d0d221" (UID: "f56100d9-ce5d-4755-bf06-5911d7d0d221"). InnerVolumeSpecName "kube-api-access-7hjd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:30:25.300147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300117    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300144    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ece915b-a3f4-4895-a369-f92415229cde-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300147 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300154    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300201    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f72s7\" (UniqueName: \"kubernetes.io/projected/f12a8a8a-d0d8-4753-a64d-b005d2d10943-kube-api-access-f72s7\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300213    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ece915b-a3f4-4895-a369-f92415229cde-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300221    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300229    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f56100d9-ce5d-4755-bf06-5911d7d0d221-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300237    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300247    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mlg2\" (UniqueName: \"kubernetes.io/projected/9ece915b-a3f4-4895-a369-f92415229cde-kube-api-access-2mlg2\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300255    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hjd6\" (UniqueName: \"kubernetes.io/projected/f56100d9-ce5d-4755-bf06-5911d7d0d221-kube-api-access-7hjd6\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300263    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12a8a8a-d0d8-4753-a64d-b005d2d10943-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.300448 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.300272    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f56100d9-ce5d-4755-bf06-5911d7d0d221-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:25.424201 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:25.424138    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg" podUID="2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 01 04:30:26.100040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.099955    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"
Nov 01 04:30:26.100557 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.099963    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2" event={"ID":"9ece915b-a3f4-4895-a369-f92415229cde","Type":"ContainerDied","Data":"75e52aa405bd8d848b91b5965d09f6b4c483265efe393a58a5c37bcda57ea9a8"}
Nov 01 04:30:26.100557 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.100076    5529 scope.go:122] "RemoveContainer" containerID="5c846883cf921fead62dc3a5d382b79e76d575ad5aef2112fa409ae8d997f2b5"
Nov 01 04:30:26.101572 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.101382    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"
Nov 01 04:30:26.101572 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.101406    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" event={"ID":"f56100d9-ce5d-4755-bf06-5911d7d0d221","Type":"ContainerDied","Data":"1fae6495d2655ba326c1ab4a4aa1f81f67a7717a943f659979e893af95c8bc03"}
Nov 01 04:30:26.102955 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.102935    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"
Nov 01 04:30:26.103066 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.102973    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl" event={"ID":"f12a8a8a-d0d8-4753-a64d-b005d2d10943","Type":"ContainerDied","Data":"412e23e6054544c212225791c118c3c02b12ff5b776f701c9471f0b37b1c1480"}
Nov 01 04:30:26.110671 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.110653    5529 scope.go:122] "RemoveContainer" containerID="340250e92ad0fac9460c0d93d25e8ddcbc504e3d5aecc91d815afc9fb855d4a4"
Nov 01 04:30:26.119708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.119685    5529 scope.go:122] "RemoveContainer" containerID="42fe357b626d071e52c286af792c6161dda5151907f06b2ea5e8e07300e95c0e"
Nov 01 04:30:26.124756 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.124719    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Nov 01 04:30:26.267279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.267240    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"]
Nov 01 04:30:26.272738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.272713    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/premium-w1-c2c259-kserve-bf847b7f9-9clhl"]
Nov 01 04:30:26.382789 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.382753    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"]
Nov 01 04:30:26.392417 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.390653    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-w1-c2c259-kserve-b65c8fc86-jf4fz"]
Nov 01 04:30:26.498718 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.498683    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"]
Nov 01 04:30:26.502253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:26.502228    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-c2c259/distinct-2-w1-c2c259-kserve-77f7fbf489-lcfc2"]
Nov 01 04:30:27.331701 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:27.331662    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:27.374153 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:27.374119    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ece915b-a3f4-4895-a369-f92415229cde" path="/var/lib/kubelet/pods/9ece915b-a3f4-4895-a369-f92415229cde/volumes"
Nov 01 04:30:27.374603 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:27.374586    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" path="/var/lib/kubelet/pods/f12a8a8a-d0d8-4753-a64d-b005d2d10943/volumes"
Nov 01 04:30:27.374956 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:27.374944    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" path="/var/lib/kubelet/pods/f56100d9-ce5d-4755-bf06-5911d7d0d221/volumes"
Nov 01 04:30:28.218428 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:28.218397    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:33.214893 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:33.214858    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:35.425058 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:35.425022    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg" podUID="2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 01 04:30:37.526070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:37.526040    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:39.165861 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:39.165829    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:39.452700 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:39.452617    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:39.630014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:39.629976    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"]
Nov 01 04:30:39.666074 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:39.665993    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:39.680083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:39.680052    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-praxis-b-b8319b-kp79l"]
Nov 01 04:30:40.072411 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:40.072377    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:41.377389 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:41.377357    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="631fedf5-539d-4417-a412-c053e045d00f" path="/var/lib/kubelet/pods/631fedf5-539d-4417-a412-c053e045d00f/volumes"
Nov 01 04:30:41.455488 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:41.455416    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 04:30:41.570731 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:41.570688    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-plugins-config-volume\") pod \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\" (UID: \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\") "
Nov 01 04:30:41.570904 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:41.570759    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-kube-api-access-pnmq9\" (UniqueName: \"kubernetes.io/projected/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-kube-api-access-pnmq9\") pod \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\" (UID: \"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568\") "
Nov 01 04:30:41.571068 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:41.571046    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-plugins-config-volume" pod "2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" (UID: "2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:30:41.571224 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:41.571201    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:41.573289 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:41.573264    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-kube-api-access-pnmq9" pod "2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" (UID: "2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568"). InnerVolumeSpecName "kube-api-access-pnmq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:30:41.672326 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:41.672292    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnmq9\" (UniqueName: \"kubernetes.io/projected/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568-kube-api-access-pnmq9\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:30:42.214635 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.214600    5529 generic.go:356] "Generic (PLEG): container finished" podID="2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" containerID="362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae" exitCode=0
Nov 01 04:30:42.214817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.214643    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"
Nov 01 04:30:42.214817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.214682    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg" event={"ID":"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568","Type":"ContainerDied","Data":"362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae"}
Nov 01 04:30:42.214817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.214737    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg" event={"ID":"2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568","Type":"ContainerDied","Data":"49521c41264dafd653a69eece3c86af42784fac53209c908a8d3a5f12a699f4a"}
Nov 01 04:30:42.214817 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.214763    5529 scope.go:122] "RemoveContainer" containerID="362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae"
Nov 01 04:30:42.225259 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.225239    5529 scope.go:122] "RemoveContainer" containerID="362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae"
Nov 01 04:30:42.225566 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:30:42.225546    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae\": container with ID starting with 362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae not found: ID does not exist" containerID="362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae"
Nov 01 04:30:42.225614 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.225577    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae"} err="failed to get container status \"362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae\": rpc error: code = NotFound desc = could not find container \"362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae\": container with ID starting with 362c0c7dc6efe6f29710df45acc6ec5adc24666f855fcbf85f26c52f82a44aae not found: ID does not exist"
Nov 01 04:30:42.382298 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.382262    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"]
Nov 01 04:30:42.432266 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:42.432227    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-c2c259-7f469b7bfc-btwfg"]
Nov 01 04:30:43.372996 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:43.372964    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" path="/var/lib/kubelet/pods/2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568/volumes"
Nov 01 04:30:44.285506 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:30:44.285461    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:30:45.081828 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:45.081797    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:45.976199 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:45.976135    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:47.193385 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:47.193294    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:47.393361 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:47.393329    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:47.867505 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:47.867464    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:50.215762 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:50.215723    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:51.665509 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:51.665474    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"]
Nov 01 04:30:51.801700 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:51.801663    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:53.663570 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:53.663538    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:53.867014 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:53.866978    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:55.310004 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:55.309972    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:59.084027 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:59.083992    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:30:59.282954 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:30:59.282927    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:00.311319 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:00.311285    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:04.651604 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:04.651568    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:06.274739 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:06.274704    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:06.502090 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:06.502057    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:06.685802 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:06.685753    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" containerName="main" containerID="cri-o://bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d" gracePeriod=45
Nov 01 04:31:06.699110 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:06.699084    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:06.948914 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:06.948847    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 04:31:07.043814 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.043769    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-tmp-dir\") pod \"976129b2-49b6-4c5f-881b-c7210355fc30\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") "
Nov 01 04:31:07.044017 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.043837    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-dshm\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-dshm\") pod \"976129b2-49b6-4c5f-881b-c7210355fc30\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") "
Nov 01 04:31:07.044017 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.043879    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/976129b2-49b6-4c5f-881b-c7210355fc30-kube-api-access-hrdk2\" (UniqueName: \"kubernetes.io/projected/976129b2-49b6-4c5f-881b-c7210355fc30-kube-api-access-hrdk2\") pod \"976129b2-49b6-4c5f-881b-c7210355fc30\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") "
Nov 01 04:31:07.044017 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.043939    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-model-cache\") pod \"976129b2-49b6-4c5f-881b-c7210355fc30\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") "
Nov 01 04:31:07.044226 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.044094    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/976129b2-49b6-4c5f-881b-c7210355fc30-tls-certs\" (UniqueName: \"kubernetes.io/secret/976129b2-49b6-4c5f-881b-c7210355fc30-tls-certs\") pod \"976129b2-49b6-4c5f-881b-c7210355fc30\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") "
Nov 01 04:31:07.044226 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.044109    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-tmp-dir" pod "976129b2-49b6-4c5f-881b-c7210355fc30" (UID: "976129b2-49b6-4c5f-881b-c7210355fc30"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:07.044226 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.044135    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-home\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-home\") pod \"976129b2-49b6-4c5f-881b-c7210355fc30\" (UID: \"976129b2-49b6-4c5f-881b-c7210355fc30\") "
Nov 01 04:31:07.044395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.044302    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-model-cache" pod "976129b2-49b6-4c5f-881b-c7210355fc30" (UID: "976129b2-49b6-4c5f-881b-c7210355fc30"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:07.044463 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.044416    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-home" pod "976129b2-49b6-4c5f-881b-c7210355fc30" (UID: "976129b2-49b6-4c5f-881b-c7210355fc30"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:07.044571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.044556    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:07.044636 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.044574    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:07.044636 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.044583    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:07.046349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.046322    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-dshm" pod "976129b2-49b6-4c5f-881b-c7210355fc30" (UID: "976129b2-49b6-4c5f-881b-c7210355fc30"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:07.046494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.046369    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/976129b2-49b6-4c5f-881b-c7210355fc30-tls-certs" pod "976129b2-49b6-4c5f-881b-c7210355fc30" (UID: "976129b2-49b6-4c5f-881b-c7210355fc30"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:31:07.046494 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.046390    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976129b2-49b6-4c5f-881b-c7210355fc30-kube-api-access-hrdk2" pod "976129b2-49b6-4c5f-881b-c7210355fc30" (UID: "976129b2-49b6-4c5f-881b-c7210355fc30"). InnerVolumeSpecName "kube-api-access-hrdk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:31:07.145277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.145245    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/976129b2-49b6-4c5f-881b-c7210355fc30-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:07.145277 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.145274    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/976129b2-49b6-4c5f-881b-c7210355fc30-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:07.145478 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.145290    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrdk2\" (UniqueName: \"kubernetes.io/projected/976129b2-49b6-4c5f-881b-c7210355fc30-kube-api-access-hrdk2\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:07.264798 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.264712    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:07.377212 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.377148    5529 generic.go:356] "Generic (PLEG): container finished" podID="976129b2-49b6-4c5f-881b-c7210355fc30" containerID="bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d" exitCode=0
Nov 01 04:31:07.377212 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.377218    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"
Nov 01 04:31:07.377702 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.377213    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" event={"ID":"976129b2-49b6-4c5f-881b-c7210355fc30","Type":"ContainerDied","Data":"bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d"}
Nov 01 04:31:07.377702 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.377267    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" event={"ID":"976129b2-49b6-4c5f-881b-c7210355fc30","Type":"ContainerDied","Data":"18eef9e89b4a809af9a7df906f1dc29772c4b53df92b2e5556783c5a8c333ad5"}
Nov 01 04:31:07.377702 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.377290    5529 scope.go:122] "RemoveContainer" containerID="bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d"
Nov 01 04:31:07.387946 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.387922    5529 scope.go:122] "RemoveContainer" containerID="bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d"
Nov 01 04:31:07.388256 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:31:07.388236    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d\": container with ID starting with bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d not found: ID does not exist" containerID="bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d"
Nov 01 04:31:07.388345 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.388268    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d"} err="failed to get container status \"bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d\": rpc error: code = NotFound desc = could not find container \"bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d\": container with ID starting with bd337bed710010c0d021a81a6e60466b95bd8aefe7f58541a57b1f50d964e05d not found: ID does not exist"
Nov 01 04:31:07.544209 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.544109    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"]
Nov 01 04:31:07.547647 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.547611    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf"]
Nov 01 04:31:07.884327 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:07.884284    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-a9c5b3/premium-w4-a9c5b3-kserve-5d78db798f-8xksf" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": context deadline exceeded"
Nov 01 04:31:09.373469 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:09.373430    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" path="/var/lib/kubelet/pods/976129b2-49b6-4c5f-881b-c7210355fc30/volumes"
Nov 01 04:31:11.166296 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:11.166263    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:12.827203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:12.827144    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:13.059132 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:13.059095    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:13.262805 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:13.262754    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:13.499940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:13.499906    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"]
Nov 01 04:31:13.500176 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:13.500142    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy" containerID="cri-o://1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8" gracePeriod=30
Nov 01 04:31:13.554363 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:13.554272    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:13.838556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:13.838463    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:14.284194 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:31:14.284132    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:31:17.519805 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:17.519767    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:18.423632 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.423596    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:18.742072 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.742035    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"]
Nov 01 04:31:18.760266 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.760240    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:31:18.869785 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.869749    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-token\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-token\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.869991 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.869795    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c9aedecf-18d9-4332-ac97-5491bd761f51-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9aedecf-18d9-4332-ac97-5491bd761f51-istiod-ca-cert\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.869991 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.869854    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-data\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.870124 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870047    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-podinfo\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.870593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870136    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-credential-socket\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.870593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870220    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-envoy\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.870593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870279    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-kube-api-access-p2m8z\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-kube-api-access-p2m8z\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.870593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870135    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-data" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:18.870593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870282    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9aedecf-18d9-4332-ac97-5491bd761f51-istiod-ca-cert" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:31:18.870593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870312    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-certs\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.870593 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870400    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-socket\") pod \"c9aedecf-18d9-4332-ac97-5491bd761f51\" (UID: \"c9aedecf-18d9-4332-ac97-5491bd761f51\") "
Nov 01 04:31:18.870987 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870821    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9aedecf-18d9-4332-ac97-5491bd761f51-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:18.870987 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.870846    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:18.871663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.871612    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-certs" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:18.871801 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.871739    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-credential-socket" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:18.871915 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.871895    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-socket" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:18.873972 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.873948    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-podinfo" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:31:18.874076 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.873985    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-token" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:31:18.874076 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.873974    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-envoy" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:18.874076 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.874019    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-kube-api-access-p2m8z" pod "c9aedecf-18d9-4332-ac97-5491bd761f51" (UID: "c9aedecf-18d9-4332-ac97-5491bd761f51"). InnerVolumeSpecName "kube-api-access-p2m8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:31:18.955875 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.955788    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:18.971808 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.971773    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:18.971808 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.971799    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:18.971808 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.971810    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:18.972109 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.971824    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:18.972109 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.971838    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:18.972109 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.971847    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2m8z\" (UniqueName: \"kubernetes.io/projected/c9aedecf-18d9-4332-ac97-5491bd761f51-kube-api-access-p2m8z\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:18.972109 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:18.971857    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9aedecf-18d9-4332-ac97-5491bd761f51-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:19.454107 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.454069    5529 generic.go:356] "Generic (PLEG): container finished" podID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerID="1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8" exitCode=0
Nov 01 04:31:19.454280 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.454123    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"
Nov 01 04:31:19.454280 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.454154    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" event={"ID":"c9aedecf-18d9-4332-ac97-5491bd761f51","Type":"ContainerDied","Data":"1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8"}
Nov 01 04:31:19.454280 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.454239    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw" event={"ID":"c9aedecf-18d9-4332-ac97-5491bd761f51","Type":"ContainerDied","Data":"4495fe38caddf152c439c980af81f241f6aa0fd87988c907d99061f6cc7d77bc"}
Nov 01 04:31:19.454280 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.454263    5529 scope.go:122] "RemoveContainer" containerID="1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8"
Nov 01 04:31:19.463978 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.463958    5529 scope.go:122] "RemoveContainer" containerID="1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8"
Nov 01 04:31:19.464280 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:31:19.464259    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8\": container with ID starting with 1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8 not found: ID does not exist" containerID="1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8"
Nov 01 04:31:19.464380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.464289    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8"} err="failed to get container status \"1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8\": rpc error: code = NotFound desc = could not find container \"1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8\": container with ID starting with 1eda53a40dc8d519c2237a9b3e5d311aeb2568a726c6360d12efcfffce67dcd8 not found: ID does not exist"
Nov 01 04:31:19.620768 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.620740    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"]
Nov 01 04:31:19.671062 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:19.670986    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-c2c259-openshift-default-6465f87cb7-zfhvw"]
Nov 01 04:31:21.373938 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:21.373905    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" path="/var/lib/kubelet/pods/c9aedecf-18d9-4332-ac97-5491bd761f51/volumes"
Nov 01 04:31:23.420287 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:23.420253    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:27.654274 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:27.654240    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:28.620951 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:28.620907    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:29.278129 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:29.278089    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:29.888765 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:29.888724    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:30.182148 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:30.182071    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:30.378678 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:30.378646    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:33.600939 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:33.600906    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:33.762930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:33.762891    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf" podUID="4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" containerName="main" containerID="cri-o://a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c" gracePeriod=45
Nov 01 04:31:34.016348 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.016318    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:31:34.023115 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023088    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-kube-api-access-m54rd\" (UniqueName: \"kubernetes.io/projected/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-kube-api-access-m54rd\") pod \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") "
Nov 01 04:31:34.023273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023151    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-model-cache\") pod \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") "
Nov 01 04:31:34.023273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023227    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tls-certs\" (UniqueName: \"kubernetes.io/secret/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tls-certs\") pod \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") "
Nov 01 04:31:34.023273 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023249    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tmp-dir\") pod \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") "
Nov 01 04:31:34.023440 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023371    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-dshm\") pod \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") "
Nov 01 04:31:34.023497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023469    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-home\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-home\") pod \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\" (UID: \"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948\") "
Nov 01 04:31:34.023497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023483    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tmp-dir" pod "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" (UID: "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:34.023607 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023498    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-model-cache" pod "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" (UID: "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:34.023767 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023740    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-home" pod "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" (UID: "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:34.023872 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023853    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:34.023930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023876    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:34.023930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.023888    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:34.025964 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.025938    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-dshm" pod "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" (UID: "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:31:34.026203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.026156    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tls-certs" pod "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" (UID: "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:31:34.033092 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.033066    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-kube-api-access-m54rd" pod "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" (UID: "4adbbde8-f3b5-4f17-8d75-dbe3c80b1948"). InnerVolumeSpecName "kube-api-access-m54rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:31:34.125291 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.125253    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:34.125291 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.125287    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:34.125521 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.125304    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m54rd\" (UniqueName: \"kubernetes.io/projected/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948-kube-api-access-m54rd\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:34.545330 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.545235    5529 generic.go:356] "Generic (PLEG): container finished" podID="4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" containerID="a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c" exitCode=0
Nov 01 04:31:34.545330 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.545302    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"
Nov 01 04:31:34.545576 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.545325    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf" event={"ID":"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948","Type":"ContainerDied","Data":"a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c"}
Nov 01 04:31:34.545576 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.545384    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf" event={"ID":"4adbbde8-f3b5-4f17-8d75-dbe3c80b1948","Type":"ContainerDied","Data":"eb7237612f8354ea6e93f21200bb660c9cec5c812c08670d8071a996ba993d38"}
Nov 01 04:31:34.545576 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.545406    5529 scope.go:122] "RemoveContainer" containerID="a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c"
Nov 01 04:31:34.555607 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.555584    5529 scope.go:122] "RemoveContainer" containerID="a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c"
Nov 01 04:31:34.555910 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:31:34.555888    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c\": container with ID starting with a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c not found: ID does not exist" containerID="a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c"
Nov 01 04:31:34.556019 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.555918    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c"} err="failed to get container status \"a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c\": rpc error: code = NotFound desc = could not find container \"a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c\": container with ID starting with a7b40bf29a76ca685c6b6abd2483dee538e51ef7c6d7492d3d63fd9874838b5c not found: ID does not exist"
Nov 01 04:31:34.710587 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.710549    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"]
Nov 01 04:31:34.742318 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:34.742283    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-praxis-a-ad9e22/praxis-route-ad9e22-kserve-cd96bdb59-wmdpf"]
Nov 01 04:31:35.372478 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:35.372444    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" path="/var/lib/kubelet/pods/4adbbde8-f3b5-4f17-8d75-dbe3c80b1948/volumes"
Nov 01 04:31:36.605640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:36.605605    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:36.802342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:36.802309    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:38.604440 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:38.604411    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:43.614375 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:43.614340    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:44.283977 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:31:44.283942    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:31:48.607624 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:48.607587    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:53.610784 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:53.610748    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:55.723577 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:55.723544    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:56.420682 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:56.420642    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:57.767389 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:57.767356    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"]
Nov 01 04:31:57.767862 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:57.767562    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m" podUID="f5c26be4-de55-4802-8e90-267eb51ba055" containerName="maas-api" containerID="cri-o://6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2" gracePeriod=30
Nov 01 04:31:57.930067 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:57.930036    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:58.052013 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.051985    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 04:31:58.174794 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.174759    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls\") pod \"f5c26be4-de55-4802-8e90-267eb51ba055\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") "
Nov 01 04:31:58.175000 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.174811    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5c26be4-de55-4802-8e90-267eb51ba055-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c26be4-de55-4802-8e90-267eb51ba055-openshift-service-ca\") pod \"f5c26be4-de55-4802-8e90-267eb51ba055\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") "
Nov 01 04:31:58.175000 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.174864    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-metrics-certs\") pod \"f5c26be4-de55-4802-8e90-267eb51ba055\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") "
Nov 01 04:31:58.175000 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.174893    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5c26be4-de55-4802-8e90-267eb51ba055-kube-api-access-tvpzv\" (UniqueName: \"kubernetes.io/projected/f5c26be4-de55-4802-8e90-267eb51ba055-kube-api-access-tvpzv\") pod \"f5c26be4-de55-4802-8e90-267eb51ba055\" (UID: \"f5c26be4-de55-4802-8e90-267eb51ba055\") "
Nov 01 04:31:58.175458 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.175429    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c26be4-de55-4802-8e90-267eb51ba055-openshift-service-ca" pod "f5c26be4-de55-4802-8e90-267eb51ba055" (UID: "f5c26be4-de55-4802-8e90-267eb51ba055"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:31:58.177612 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.177574    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls" pod "f5c26be4-de55-4802-8e90-267eb51ba055" (UID: "f5c26be4-de55-4802-8e90-267eb51ba055"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:31:58.177865 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.177837    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-metrics-certs" pod "f5c26be4-de55-4802-8e90-267eb51ba055" (UID: "f5c26be4-de55-4802-8e90-267eb51ba055"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:31:58.177865 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.177850    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c26be4-de55-4802-8e90-267eb51ba055-kube-api-access-tvpzv" pod "f5c26be4-de55-4802-8e90-267eb51ba055" (UID: "f5c26be4-de55-4802-8e90-267eb51ba055"). InnerVolumeSpecName "kube-api-access-tvpzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:31:58.275737 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.275702    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:58.275737 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.275733    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c26be4-de55-4802-8e90-267eb51ba055-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:58.275930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.275748    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5c26be4-de55-4802-8e90-267eb51ba055-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:58.275930 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.275757    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvpzv\" (UniqueName: \"kubernetes.io/projected/f5c26be4-de55-4802-8e90-267eb51ba055-kube-api-access-tvpzv\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:31:58.685868 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.685831    5529 generic.go:356] "Generic (PLEG): container finished" podID="f5c26be4-de55-4802-8e90-267eb51ba055" containerID="6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2" exitCode=0
Nov 01 04:31:58.686091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.685889    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"
Nov 01 04:31:58.686091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.685907    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m" event={"ID":"f5c26be4-de55-4802-8e90-267eb51ba055","Type":"ContainerDied","Data":"6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2"}
Nov 01 04:31:58.686091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.685959    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m" event={"ID":"f5c26be4-de55-4802-8e90-267eb51ba055","Type":"ContainerDied","Data":"3f3b5559ed0a13299426392aaf46884facb526a7e6e9d4405c9ee33a4c24e8c3"}
Nov 01 04:31:58.686091 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.685980    5529 scope.go:122] "RemoveContainer" containerID="6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2"
Nov 01 04:31:58.697543 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.697523    5529 scope.go:122] "RemoveContainer" containerID="6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2"
Nov 01 04:31:58.697838 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:31:58.697817    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2\": container with ID starting with 6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2 not found: ID does not exist" containerID="6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2"
Nov 01 04:31:58.697924 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.697849    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2"} err="failed to get container status \"6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2\": rpc error: code = NotFound desc = could not find container \"6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2\": container with ID starting with 6fd00f9aa8327e8ade02a812a5d7bf593b14b597d0d3235d99ba194c2e9c9fc2 not found: ID does not exist"
Nov 01 04:31:58.852241 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.852184    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"]
Nov 01 04:31:58.855883 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:58.855854    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-a9c5b3-5c6f449f68-dr77m"]
Nov 01 04:31:59.373374 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:59.373342    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5c26be4-de55-4802-8e90-267eb51ba055" path="/var/lib/kubelet/pods/f5c26be4-de55-4802-8e90-267eb51ba055/volumes"
Nov 01 04:31:59.498784 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:59.498753    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:59.784310 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:59.784275    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:31:59.986893 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:31:59.986857    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:00.426623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:00.426590    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:02.142139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:02.142110    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:02.352286 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:02.352259    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:02.558220 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:02.558092    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:05.175110 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:05.175078    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:06.959106 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:06.959060    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"]
Nov 01 04:32:06.959654 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:06.959428    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy" containerID="cri-o://17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003" gracePeriod=30
Nov 01 04:32:06.978678 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:06.978645    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:10.438443 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:10.438400    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:11.517861 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:11.517824    5529 patch_prober.go:29] interesting pod/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 01 04:32:11.518345 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:11.517885    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 01 04:32:12.216025 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.215995    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:32:12.309712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309635    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-envoy\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.309712 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309680    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-socket\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.309940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309716    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-podinfo\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.309940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309745    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-credential-socket\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.309940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309780    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-kube-api-access-kdcgf\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-kube-api-access-kdcgf\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.309940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309813    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-certs\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.309940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309861    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istiod-ca-cert\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.309940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309892    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-token\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-token\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.309940 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.309926    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-data\") pod \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\" (UID: \"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93\") "
Nov 01 04:32:12.310342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310052    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-socket" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:12.310342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310137    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-credential-socket" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:12.310342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310236    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-certs" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:12.310342 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310325    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-data" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:12.310572 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310359    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istiod-ca-cert" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:32:12.310699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310670    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.310699 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310696    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.310860 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310711    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.310860 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310727    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.310860 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.310740    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.312004 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.311978    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-envoy" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:12.312145 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.312123    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-podinfo" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:32:12.312228 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.312147    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-kube-api-access-kdcgf" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "kube-api-access-kdcgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:32:12.312286 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.312250    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-token" pod "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" (UID: "fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:32:12.411552 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.411506    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdcgf\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-kube-api-access-kdcgf\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.411552 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.411548    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.411876 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.411566    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.411876 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.411579    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:12.774425 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.774392    5529 generic.go:356] "Generic (PLEG): container finished" podID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerID="17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003" exitCode=0
Nov 01 04:32:12.774917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.774467    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"
Nov 01 04:32:12.774917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.774480    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" event={"ID":"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93","Type":"ContainerDied","Data":"17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003"}
Nov 01 04:32:12.774917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.774535    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n" event={"ID":"fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93","Type":"ContainerDied","Data":"1e0c07f2b94c48daa63f7e05e18238990f7ea9732e134926abf57b2d67237754"}
Nov 01 04:32:12.774917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.774557    5529 scope.go:122] "RemoveContainer" containerID="17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003"
Nov 01 04:32:12.787648 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.787127    5529 scope.go:122] "RemoveContainer" containerID="17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003"
Nov 01 04:32:12.787751 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:32:12.787662    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003\": container with ID starting with 17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003 not found: ID does not exist" containerID="17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003"
Nov 01 04:32:12.787751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.787690    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003"} err="failed to get container status \"17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003\": rpc error: code = NotFound desc = could not find container \"17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003\": container with ID starting with 17b0b5b5d242b289647a3ed2e9212e9d6901f920071afbc107b5060a0ea6d003 not found: ID does not exist"
Nov 01 04:32:12.940973 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.940943    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"]
Nov 01 04:32:12.990857 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:12.990806    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-a9c5b3-openshift-default-594d45cd9f-r6s7n"]
Nov 01 04:32:13.372184 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:13.372134    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" path="/var/lib/kubelet/pods/fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93/volumes"
Nov 01 04:32:14.283844 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:32:14.283810    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:32:14.727999 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:14.727966    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:15.060957 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:15.060871    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:15.266394 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:15.266362    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:16.593056 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:16.593023    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:17.913002 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:17.912966    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:18.853449 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:18.853406    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:19.136652 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:19.136612    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:19.780368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:19.780333    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:21.847189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:21.847118    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:25.815509 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:25.815471    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:26.015321 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:26.015285    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:26.214601 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:26.214547    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:26.928759 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:26.928726    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:27.994017 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:27.993966    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:32.322754 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:32.322714    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:37.296242 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:37.296205    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:38.470875 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:38.470795    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"]
Nov 01 04:32:38.776144 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:38.776059    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:38.973349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:38.973320    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:39.087025 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:39.086945    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"]
Nov 01 04:32:39.087203 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:39.087154    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy" containerID="cri-o://3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9" gracePeriod=30
Nov 01 04:32:42.307070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:42.307034    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:43.471971 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:43.471916    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv" podUID="a051d661-123d-439f-aa76-fc5fea5d4c1c" containerName="payload-pre-processing" containerID="cri-o://00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b" gracePeriod=25
Nov 01 04:32:44.288256 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:32:44.288219    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:32:44.341821 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.341794    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 04:32:44.439275 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439239    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-data\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439275 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439275    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-token\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-token\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439297    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istiod-ca-cert\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439323    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-certs\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439341    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-podinfo\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439378    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-kube-api-access-8vmnv\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-kube-api-access-8vmnv\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439409    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-envoy\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439440    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-credential-socket\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439550 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439528    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-socket\") pod \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\" (UID: \"b49f3a8c-500e-45a7-bbdd-dc0816028af4\") "
Nov 01 04:32:44.439933 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439602    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-certs" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:44.439933 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439785    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istiod-ca-cert" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:32:44.439933 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439868    5529 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.439933 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439615    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-data" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:44.440133 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.439900    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-socket" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:44.440133 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.440003    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-credential-socket" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:44.441696 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.441676    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-podinfo" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 01 04:32:44.441834 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.441756    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-token" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:32:44.442023 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.442007    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-envoy" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:32:44.442100 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.442019    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-kube-api-access-8vmnv" pod "b49f3a8c-500e-45a7-bbdd-dc0816028af4" (UID: "b49f3a8c-500e-45a7-bbdd-dc0816028af4"). InnerVolumeSpecName "kube-api-access-8vmnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:32:44.540980 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.540947    5529 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-workload-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.540980 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.540977    5529 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-data\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.540980 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.540986    5529 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-token\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.541470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.540994    5529 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istiod-ca-cert\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.541470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.541004    5529 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-podinfo\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.541470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.541013    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vmnv\" (UniqueName: \"kubernetes.io/projected/b49f3a8c-500e-45a7-bbdd-dc0816028af4-kube-api-access-8vmnv\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.541470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.541021    5529 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-istio-envoy\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.541470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.541030    5529 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b49f3a8c-500e-45a7-bbdd-dc0816028af4-credential-socket\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:44.962716 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.962679    5529 generic.go:356] "Generic (PLEG): container finished" podID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerID="3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9" exitCode=0
Nov 01 04:32:44.962899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.962724    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"
Nov 01 04:32:44.962899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.962730    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" event={"ID":"b49f3a8c-500e-45a7-bbdd-dc0816028af4","Type":"ContainerDied","Data":"3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9"}
Nov 01 04:32:44.962899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.962780    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28" event={"ID":"b49f3a8c-500e-45a7-bbdd-dc0816028af4","Type":"ContainerDied","Data":"c2f948dc1af020bb85dd502ef04658f92b0001d60cacfeebd91b629605b6cbcc"}
Nov 01 04:32:44.962899 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.962804    5529 scope.go:122] "RemoveContainer" containerID="3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9"
Nov 01 04:32:44.973688 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.973667    5529 scope.go:122] "RemoveContainer" containerID="3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9"
Nov 01 04:32:44.974011 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:32:44.973988    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9\": container with ID starting with 3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9 not found: ID does not exist" containerID="3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9"
Nov 01 04:32:44.974082 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:44.974022    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9"} err="failed to get container status \"3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9\": rpc error: code = NotFound desc = could not find container \"3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9\": container with ID starting with 3d5d1ca8e955db1ebda1444aede5ef64d0c0d5fc8819803e6b744d13205f55c9 not found: ID does not exist"
Nov 01 04:32:45.129112 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:45.129075    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"]
Nov 01 04:32:45.179362 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:45.179328    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df48fcc99-hdk28"]
Nov 01 04:32:45.372360 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:45.372269    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" path="/var/lib/kubelet/pods/b49f3a8c-500e-45a7-bbdd-dc0816028af4/volumes"
Nov 01 04:32:47.304788 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:47.304699    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:48.235661 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:48.235620    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv" podUID="a051d661-123d-439f-aa76-fc5fea5d4c1c" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 01 04:32:51.523241 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.523206    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"]
Nov 01 04:32:51.523668 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.523438    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh" podUID="e53644f9-dd7a-48a7-bf11-e208d7d9a64f" containerName="maas-api" containerID="cri-o://90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed" gracePeriod=30
Nov 01 04:32:51.680455 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.680417    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:51.773755 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.773691    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:32:51.805915 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.805882    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls\") pod \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") "
Nov 01 04:32:51.806095 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.805958    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-openshift-service-ca\") pod \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") "
Nov 01 04:32:51.806095 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.805982    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-metrics-certs\") pod \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") "
Nov 01 04:32:51.806305 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.806004    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-kube-api-access-psjzv\" (UniqueName: \"kubernetes.io/projected/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-kube-api-access-psjzv\") pod \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\" (UID: \"e53644f9-dd7a-48a7-bf11-e208d7d9a64f\") "
Nov 01 04:32:51.806387 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.806362    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-openshift-service-ca" pod "e53644f9-dd7a-48a7-bf11-e208d7d9a64f" (UID: "e53644f9-dd7a-48a7-bf11-e208d7d9a64f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:32:51.806663 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.806641    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:51.808229 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.808199    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-kube-api-access-psjzv" pod "e53644f9-dd7a-48a7-bf11-e208d7d9a64f" (UID: "e53644f9-dd7a-48a7-bf11-e208d7d9a64f"). InnerVolumeSpecName "kube-api-access-psjzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:32:51.808327 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.808296    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-metrics-certs" pod "e53644f9-dd7a-48a7-bf11-e208d7d9a64f" (UID: "e53644f9-dd7a-48a7-bf11-e208d7d9a64f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:32:51.808327 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.808314    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls" pod "e53644f9-dd7a-48a7-bf11-e208d7d9a64f" (UID: "e53644f9-dd7a-48a7-bf11-e208d7d9a64f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:32:51.907708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.907674    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:51.907708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.907703    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psjzv\" (UniqueName: \"kubernetes.io/projected/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-kube-api-access-psjzv\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:51.907708 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:51.907713    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e53644f9-dd7a-48a7-bf11-e208d7d9a64f-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:32:52.007294 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.007257    5529 generic.go:356] "Generic (PLEG): container finished" podID="e53644f9-dd7a-48a7-bf11-e208d7d9a64f" containerID="90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed" exitCode=0
Nov 01 04:32:52.007464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.007303    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"
Nov 01 04:32:52.007464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.007342    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh" event={"ID":"e53644f9-dd7a-48a7-bf11-e208d7d9a64f","Type":"ContainerDied","Data":"90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed"}
Nov 01 04:32:52.007464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.007395    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh" event={"ID":"e53644f9-dd7a-48a7-bf11-e208d7d9a64f","Type":"ContainerDied","Data":"254baf1df8fb79fc4c24b64aa55eb7af48324309d324f895516dafc66296f0ac"}
Nov 01 04:32:52.007464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.007418    5529 scope.go:122] "RemoveContainer" containerID="90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed"
Nov 01 04:32:52.017136 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.017117    5529 scope.go:122] "RemoveContainer" containerID="90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed"
Nov 01 04:32:52.017427 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:32:52.017404    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed\": container with ID starting with 90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed not found: ID does not exist" containerID="90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed"
Nov 01 04:32:52.017507 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.017436    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed"} err="failed to get container status \"90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed\": rpc error: code = NotFound desc = could not find container \"90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed\": container with ID starting with 90dc54e1dedb8f6f0e0e6c0ca0b82fd9114ea4a8175b35203862624ded76d0ed not found: ID does not exist"
Nov 01 04:32:52.172989 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.172955    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"]
Nov 01 04:32:52.176644 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:52.176623    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-4adf4c-98bd57fdb-cxbdh"]
Nov 01 04:32:53.276283 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:53.276246    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:53.372129 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:53.372085    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e53644f9-dd7a-48a7-bf11-e208d7d9a64f" path="/var/lib/kubelet/pods/e53644f9-dd7a-48a7-bf11-e208d7d9a64f/volumes"
Nov 01 04:32:53.505802 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:53.505769    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:53.703681 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:53.703648    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:54.190251 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:54.190224    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:58.235752 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:58.235714    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv" podUID="a051d661-123d-439f-aa76-fc5fea5d4c1c" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 01 04:32:58.732584 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:58.732551    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:32:59.842751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:59.842725    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:32:59.857316 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:32:59.857294    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nb2ld_40a71ede-b75a-4381-8299-49e46083e654/kube-multus/0.log"
Nov 01 04:33:00.236569 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:00.236534    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:00.441724 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:00.441693    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:00.642831 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:00.642803    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:03.741054 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:03.740993    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:33:03.813125 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:03.813085    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a051d661-123d-439f-aa76-fc5fea5d4c1c-kube-api-access-5l9fp\" (UniqueName: \"kubernetes.io/projected/a051d661-123d-439f-aa76-fc5fea5d4c1c-kube-api-access-5l9fp\") pod \"a051d661-123d-439f-aa76-fc5fea5d4c1c\" (UID: \"a051d661-123d-439f-aa76-fc5fea5d4c1c\") "
Nov 01 04:33:03.813350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:03.813159    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a051d661-123d-439f-aa76-fc5fea5d4c1c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a051d661-123d-439f-aa76-fc5fea5d4c1c-plugins-config-volume\") pod \"a051d661-123d-439f-aa76-fc5fea5d4c1c\" (UID: \"a051d661-123d-439f-aa76-fc5fea5d4c1c\") "
Nov 01 04:33:03.813728 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:03.813695    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a051d661-123d-439f-aa76-fc5fea5d4c1c-plugins-config-volume" pod "a051d661-123d-439f-aa76-fc5fea5d4c1c" (UID: "a051d661-123d-439f-aa76-fc5fea5d4c1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:33:03.815362 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:03.815334    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a051d661-123d-439f-aa76-fc5fea5d4c1c-kube-api-access-5l9fp" pod "a051d661-123d-439f-aa76-fc5fea5d4c1c" (UID: "a051d661-123d-439f-aa76-fc5fea5d4c1c"). InnerVolumeSpecName "kube-api-access-5l9fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:33:03.914686 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:03.914648    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l9fp\" (UniqueName: \"kubernetes.io/projected/a051d661-123d-439f-aa76-fc5fea5d4c1c-kube-api-access-5l9fp\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:03.914686 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:03.914684    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a051d661-123d-439f-aa76-fc5fea5d4c1c-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:03.997717 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:03.997640    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:04.081999 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.081966    5529 generic.go:356] "Generic (PLEG): container finished" podID="a051d661-123d-439f-aa76-fc5fea5d4c1c" containerID="00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b" exitCode=0
Nov 01 04:33:04.082191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.082015    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"
Nov 01 04:33:04.082191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.082056    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv" event={"ID":"a051d661-123d-439f-aa76-fc5fea5d4c1c","Type":"ContainerDied","Data":"00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b"}
Nov 01 04:33:04.082191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.082108    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv" event={"ID":"a051d661-123d-439f-aa76-fc5fea5d4c1c","Type":"ContainerDied","Data":"ba924dba39b17a10fabb2a9a70df924892f30e47938faf9a32929077b10481e5"}
Nov 01 04:33:04.082191 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.082133    5529 scope.go:122] "RemoveContainer" containerID="00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b"
Nov 01 04:33:04.094093 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.093981    5529 scope.go:122] "RemoveContainer" containerID="00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b"
Nov 01 04:33:04.094400 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:33:04.094376    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b\": container with ID starting with 00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b not found: ID does not exist" containerID="00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b"
Nov 01 04:33:04.094498 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.094410    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b"} err="failed to get container status \"00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b\": rpc error: code = NotFound desc = could not find container \"00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b\": container with ID starting with 00e93124479ab2616305f75d8e8465a3908eb0b3744613e4edc5d54de56bee3b not found: ID does not exist"
Nov 01 04:33:04.248343 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.248263    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"]
Nov 01 04:33:04.252457 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:04.252428    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4adf4c-8f6b9f55-mfbnv"]
Nov 01 04:33:05.373705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:05.373672    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a051d661-123d-439f-aa76-fc5fea5d4c1c" path="/var/lib/kubelet/pods/a051d661-123d-439f-aa76-fc5fea5d4c1c/volumes"
Nov 01 04:33:09.109033 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:09.108971    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:12.808946 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:12.808905    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"]
Nov 01 04:33:12.914047 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:12.914003    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"]
Nov 01 04:33:13.206913 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:13.206885    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:13.402796 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:13.402765    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:14.115253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:14.115224    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:14.284525 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:33:14.284481    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:33:17.810108 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:17.810060    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7" podUID="07739fcc-12ec-471b-a529-750e9c43bc47" containerName="payload-processing" containerID="cri-o://3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5" gracePeriod=25
Nov 01 04:33:17.914945 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:17.914892    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb" podUID="1dfc6927-b1e8-4b84-a9b7-df730fdffc5a" containerName="payload-pre-processing" containerID="cri-o://b3c3480695639f2e7fc694ff841c2fe0615d7df20d7e3ad4cf3779c887bc6c52" gracePeriod=25
Nov 01 04:33:18.077929 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.077902    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:33:18.157648 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.157620    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07739fcc-12ec-471b-a529-750e9c43bc47-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07739fcc-12ec-471b-a529-750e9c43bc47-plugins-config-volume\") pod \"07739fcc-12ec-471b-a529-750e9c43bc47\" (UID: \"07739fcc-12ec-471b-a529-750e9c43bc47\") "
Nov 01 04:33:18.157832 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.157663    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07739fcc-12ec-471b-a529-750e9c43bc47-kube-api-access-wtpr8\" (UniqueName: \"kubernetes.io/projected/07739fcc-12ec-471b-a529-750e9c43bc47-kube-api-access-wtpr8\") pod \"07739fcc-12ec-471b-a529-750e9c43bc47\" (UID: \"07739fcc-12ec-471b-a529-750e9c43bc47\") "
Nov 01 04:33:18.158119 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.158056    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07739fcc-12ec-471b-a529-750e9c43bc47-plugins-config-volume" pod "07739fcc-12ec-471b-a529-750e9c43bc47" (UID: "07739fcc-12ec-471b-a529-750e9c43bc47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:33:18.160000 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.159974    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07739fcc-12ec-471b-a529-750e9c43bc47-kube-api-access-wtpr8" pod "07739fcc-12ec-471b-a529-750e9c43bc47" (UID: "07739fcc-12ec-471b-a529-750e9c43bc47"). InnerVolumeSpecName "kube-api-access-wtpr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:33:18.161785 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.161757    5529 generic.go:356] "Generic (PLEG): container finished" podID="07739fcc-12ec-471b-a529-750e9c43bc47" containerID="3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5" exitCode=0
Nov 01 04:33:18.161891 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.161802    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"
Nov 01 04:33:18.161891 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.161832    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7" event={"ID":"07739fcc-12ec-471b-a529-750e9c43bc47","Type":"ContainerDied","Data":"3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5"}
Nov 01 04:33:18.161891 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.161882    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7" event={"ID":"07739fcc-12ec-471b-a529-750e9c43bc47","Type":"ContainerDied","Data":"1ff24916c82e6d185a531fcd99945a02e7353df3c79eec96cafd8489e78e1331"}
Nov 01 04:33:18.162065 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.161899    5529 scope.go:122] "RemoveContainer" containerID="3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5"
Nov 01 04:33:18.163403 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.163384    5529 generic.go:356] "Generic (PLEG): container finished" podID="1dfc6927-b1e8-4b84-a9b7-df730fdffc5a" containerID="b3c3480695639f2e7fc694ff841c2fe0615d7df20d7e3ad4cf3779c887bc6c52" exitCode=0
Nov 01 04:33:18.163499 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.163462    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb" event={"ID":"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a","Type":"ContainerDied","Data":"b3c3480695639f2e7fc694ff841c2fe0615d7df20d7e3ad4cf3779c887bc6c52"}
Nov 01 04:33:18.175052 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.175035    5529 scope.go:122] "RemoveContainer" containerID="3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5"
Nov 01 04:33:18.175309 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:33:18.175291    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5\": container with ID starting with 3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5 not found: ID does not exist" containerID="3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5"
Nov 01 04:33:18.175368 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.175317    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5"} err="failed to get container status \"3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5\": rpc error: code = NotFound desc = could not find container \"3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5\": container with ID starting with 3e855e8a1f4867c0548e4398af633be3ce24aed7a3c93c9c94eb5fc838b406c5 not found: ID does not exist"
Nov 01 04:33:18.178254 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.178236    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:33:18.258706 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.258674    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-plugins-config-volume\") pod \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\" (UID: \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\") "
Nov 01 04:33:18.258882 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.258717    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-kube-api-access-n8jsv\" (UniqueName: \"kubernetes.io/projected/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-kube-api-access-n8jsv\") pod \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\" (UID: \"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a\") "
Nov 01 04:33:18.258999 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.258980    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07739fcc-12ec-471b-a529-750e9c43bc47-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:18.259037 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.259007    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtpr8\" (UniqueName: \"kubernetes.io/projected/07739fcc-12ec-471b-a529-750e9c43bc47-kube-api-access-wtpr8\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:18.259129 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.259113    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-plugins-config-volume" pod "1dfc6927-b1e8-4b84-a9b7-df730fdffc5a" (UID: "1dfc6927-b1e8-4b84-a9b7-df730fdffc5a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:33:18.260901 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.260879    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-kube-api-access-n8jsv" pod "1dfc6927-b1e8-4b84-a9b7-df730fdffc5a" (UID: "1dfc6927-b1e8-4b84-a9b7-df730fdffc5a"). InnerVolumeSpecName "kube-api-access-n8jsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:33:18.277680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.277655    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:18.307207 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.307176    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"]
Nov 01 04:33:18.310495 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.310418    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-fb1c1f-bc87b6c89-crgc7"]
Nov 01 04:33:18.359751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.359710    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8jsv\" (UniqueName: \"kubernetes.io/projected/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-kube-api-access-n8jsv\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:18.359751 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:18.359751    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:19.112421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:19.112340    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:19.171363 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:19.171331    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"
Nov 01 04:33:19.171363 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:19.171356    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb" event={"ID":"1dfc6927-b1e8-4b84-a9b7-df730fdffc5a","Type":"ContainerDied","Data":"e10d66b3931a06aa1e6ee670486965917617742c4b8f26c079eb07b8f5e1766b"}
Nov 01 04:33:19.171628 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:19.171407    5529 scope.go:122] "RemoveContainer" containerID="b3c3480695639f2e7fc694ff841c2fe0615d7df20d7e3ad4cf3779c887bc6c52"
Nov 01 04:33:19.336680 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:19.336648    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"]
Nov 01 04:33:19.340615 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:19.340592    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fb1c1f-549cb8769f-pqslb"]
Nov 01 04:33:19.371677 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:19.371589    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07739fcc-12ec-471b-a529-750e9c43bc47" path="/var/lib/kubelet/pods/07739fcc-12ec-471b-a529-750e9c43bc47/volumes"
Nov 01 04:33:19.372052 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:19.372029    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1dfc6927-b1e8-4b84-a9b7-df730fdffc5a" path="/var/lib/kubelet/pods/1dfc6927-b1e8-4b84-a9b7-df730fdffc5a/volumes"
Nov 01 04:33:23.338847 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.338813    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"]
Nov 01 04:33:23.339330 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.339024    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42" podUID="5de9edb2-43c4-4215-a436-e7d98eb2815f" containerName="maas-api" containerID="cri-o://b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534" gracePeriod=30
Nov 01 04:33:23.508561 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.508531    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:23.593080 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.593008    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:33:23.705897 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.705862    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-metrics-certs\") pod \"5de9edb2-43c4-4215-a436-e7d98eb2815f\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") "
Nov 01 04:33:23.705897 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.705900    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5de9edb2-43c4-4215-a436-e7d98eb2815f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de9edb2-43c4-4215-a436-e7d98eb2815f-openshift-service-ca\") pod \"5de9edb2-43c4-4215-a436-e7d98eb2815f\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") "
Nov 01 04:33:23.706122 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.705998    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-maas-api-tls\") pod \"5de9edb2-43c4-4215-a436-e7d98eb2815f\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") "
Nov 01 04:33:23.706122 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.706078    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5de9edb2-43c4-4215-a436-e7d98eb2815f-kube-api-access-jjc9r\" (UniqueName: \"kubernetes.io/projected/5de9edb2-43c4-4215-a436-e7d98eb2815f-kube-api-access-jjc9r\") pod \"5de9edb2-43c4-4215-a436-e7d98eb2815f\" (UID: \"5de9edb2-43c4-4215-a436-e7d98eb2815f\") "
Nov 01 04:33:23.706374 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.706347    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5de9edb2-43c4-4215-a436-e7d98eb2815f-openshift-service-ca" pod "5de9edb2-43c4-4215-a436-e7d98eb2815f" (UID: "5de9edb2-43c4-4215-a436-e7d98eb2815f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:33:23.709056 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.709026    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-metrics-certs" pod "5de9edb2-43c4-4215-a436-e7d98eb2815f" (UID: "5de9edb2-43c4-4215-a436-e7d98eb2815f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:33:23.709252 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.709100    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-maas-api-tls" pod "5de9edb2-43c4-4215-a436-e7d98eb2815f" (UID: "5de9edb2-43c4-4215-a436-e7d98eb2815f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:33:23.709252 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.709143    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5de9edb2-43c4-4215-a436-e7d98eb2815f-kube-api-access-jjc9r" pod "5de9edb2-43c4-4215-a436-e7d98eb2815f" (UID: "5de9edb2-43c4-4215-a436-e7d98eb2815f"). InnerVolumeSpecName "kube-api-access-jjc9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:33:23.807054 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.807017    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjc9r\" (UniqueName: \"kubernetes.io/projected/5de9edb2-43c4-4215-a436-e7d98eb2815f-kube-api-access-jjc9r\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:23.807054 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.807048    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:23.807054 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.807057    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5de9edb2-43c4-4215-a436-e7d98eb2815f-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:23.807324 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:23.807066    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5de9edb2-43c4-4215-a436-e7d98eb2815f-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:24.199787 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.199748    5529 generic.go:356] "Generic (PLEG): container finished" podID="5de9edb2-43c4-4215-a436-e7d98eb2815f" containerID="b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534" exitCode=0
Nov 01 04:33:24.199986 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.199796    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"
Nov 01 04:33:24.199986 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.199828    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42" event={"ID":"5de9edb2-43c4-4215-a436-e7d98eb2815f","Type":"ContainerDied","Data":"b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534"}
Nov 01 04:33:24.199986 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.199882    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42" event={"ID":"5de9edb2-43c4-4215-a436-e7d98eb2815f","Type":"ContainerDied","Data":"f78bb2f5223b6e3501479c11e4d1125eb7278983dc80e317015955f3f2c5b139"}
Nov 01 04:33:24.199986 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.199908    5529 scope.go:122] "RemoveContainer" containerID="b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534"
Nov 01 04:33:24.209329 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.209302    5529 scope.go:122] "RemoveContainer" containerID="b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534"
Nov 01 04:33:24.209658 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:33:24.209638    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534\": container with ID starting with b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534 not found: ID does not exist" containerID="b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534"
Nov 01 04:33:24.209733 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.209673    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534"} err="failed to get container status \"b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534\": rpc error: code = NotFound desc = could not find container \"b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534\": container with ID starting with b2e7b8626a8282b9d7037524830d81e0736752a1ab776b8984bf50b7a7838534 not found: ID does not exist"
Nov 01 04:33:24.365623 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.365587    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"]
Nov 01 04:33:24.416052 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:24.416014    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-fb1c1f-5c654d5944-g4p42"]
Nov 01 04:33:25.082612 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:25.082577    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:25.371670 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:25.371574    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:25.372795 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:25.372774    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5de9edb2-43c4-4215-a436-e7d98eb2815f" path="/var/lib/kubelet/pods/5de9edb2-43c4-4215-a436-e7d98eb2815f/volumes"
Nov 01 04:33:25.576060 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:25.576030    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:25.996336 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:25.996300    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:28.342883 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:28.342848    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:30.700895 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:30.700862    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:32.066963 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:32.066916    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:32.262037 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:32.261999    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:32.462719 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:32.462685    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:32.872728 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:32.872640    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:36.053819 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:36.053789    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:37.776418 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:37.776381    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"]
Nov 01 04:33:37.997902 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:37.997868    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:41.120916 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:41.120885    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:44.283983 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:33:44.283949    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:33:44.875392 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:44.875354    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"]
Nov 01 04:33:45.170301 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:45.170217    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:45.373392 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:45.373360    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:33:49.876692 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:49.876646    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk" podUID="36feab29-2aec-4575-9239-e821865b9336" containerName="payload-pre-processing" containerID="cri-o://0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348" gracePeriod=25
Nov 01 04:33:52.796627 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:52.796571    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt" podUID="4f93737e-433c-4f70-b7e8-179a110cd2b3" containerName="main" containerID="cri-o://237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1" gracePeriod=45
Nov 01 04:33:53.038047 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.038016    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:33:53.090077 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.089993    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-tmp-dir\") pod \"4f93737e-433c-4f70-b7e8-179a110cd2b3\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") "
Nov 01 04:33:53.090077 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090034    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-home\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-home\") pod \"4f93737e-433c-4f70-b7e8-179a110cd2b3\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") "
Nov 01 04:33:53.090350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090118    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4f93737e-433c-4f70-b7e8-179a110cd2b3-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f93737e-433c-4f70-b7e8-179a110cd2b3-tls-certs\") pod \"4f93737e-433c-4f70-b7e8-179a110cd2b3\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") "
Nov 01 04:33:53.090350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090216    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-dshm\") pod \"4f93737e-433c-4f70-b7e8-179a110cd2b3\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") "
Nov 01 04:33:53.090350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090250    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f93737e-433c-4f70-b7e8-179a110cd2b3-kube-api-access-m5crh\" (UniqueName: \"kubernetes.io/projected/4f93737e-433c-4f70-b7e8-179a110cd2b3-kube-api-access-m5crh\") pod \"4f93737e-433c-4f70-b7e8-179a110cd2b3\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") "
Nov 01 04:33:53.090350 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090285    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-model-cache\") pod \"4f93737e-433c-4f70-b7e8-179a110cd2b3\" (UID: \"4f93737e-433c-4f70-b7e8-179a110cd2b3\") "
Nov 01 04:33:53.090556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090347    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-home" pod "4f93737e-433c-4f70-b7e8-179a110cd2b3" (UID: "4f93737e-433c-4f70-b7e8-179a110cd2b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:33:53.090556 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090356    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-tmp-dir" pod "4f93737e-433c-4f70-b7e8-179a110cd2b3" (UID: "4f93737e-433c-4f70-b7e8-179a110cd2b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:33:53.090662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090603    5529 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-tmp-dir\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:53.090662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090620    5529 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-home\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:53.090662 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.090618    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-model-cache" pod "4f93737e-433c-4f70-b7e8-179a110cd2b3" (UID: "4f93737e-433c-4f70-b7e8-179a110cd2b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:33:53.092517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.092491    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-dshm" pod "4f93737e-433c-4f70-b7e8-179a110cd2b3" (UID: "4f93737e-433c-4f70-b7e8-179a110cd2b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 01 04:33:53.092517 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.092502    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f93737e-433c-4f70-b7e8-179a110cd2b3-tls-certs" pod "4f93737e-433c-4f70-b7e8-179a110cd2b3" (UID: "4f93737e-433c-4f70-b7e8-179a110cd2b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:33:53.092666 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.092541    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f93737e-433c-4f70-b7e8-179a110cd2b3-kube-api-access-m5crh" pod "4f93737e-433c-4f70-b7e8-179a110cd2b3" (UID: "4f93737e-433c-4f70-b7e8-179a110cd2b3"). InnerVolumeSpecName "kube-api-access-m5crh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:33:53.191079 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.191046    5529 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f93737e-433c-4f70-b7e8-179a110cd2b3-tls-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:53.191079 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.191075    5529 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-dshm\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:53.191079 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.191086    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5crh\" (UniqueName: \"kubernetes.io/projected/4f93737e-433c-4f70-b7e8-179a110cd2b3-kube-api-access-m5crh\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:53.191335 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.191095    5529 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f93737e-433c-4f70-b7e8-179a110cd2b3-model-cache\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:33:53.292189 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.292120    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk" podUID="36feab29-2aec-4575-9239-e821865b9336" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 01 04:33:53.362732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.362639    5529 generic.go:356] "Generic (PLEG): container finished" podID="4f93737e-433c-4f70-b7e8-179a110cd2b3" containerID="237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1" exitCode=0
Nov 01 04:33:53.362732 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.362705    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"
Nov 01 04:33:53.362973 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.362728    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt" event={"ID":"4f93737e-433c-4f70-b7e8-179a110cd2b3","Type":"ContainerDied","Data":"237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1"}
Nov 01 04:33:53.362973 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.362791    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt" event={"ID":"4f93737e-433c-4f70-b7e8-179a110cd2b3","Type":"ContainerDied","Data":"8327d05559d4e4965a99c04d5102b931e8d696932e42696f57b09f374e757a98"}
Nov 01 04:33:53.362973 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.362818    5529 scope.go:122] "RemoveContainer" containerID="237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1"
Nov 01 04:33:53.374332 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.374299    5529 scope.go:122] "RemoveContainer" containerID="237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1"
Nov 01 04:33:53.376535 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:33:53.376422    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1\": container with ID starting with 237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1 not found: ID does not exist" containerID="237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1"
Nov 01 04:33:53.376535 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.376459    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1"} err="failed to get container status \"237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1\": rpc error: code = NotFound desc = could not find container \"237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1\": container with ID starting with 237e042bd1bc381583ea18623da1196da6635d9be12804e31a6f74eb140f8cb1 not found: ID does not exist"
Nov 01 04:33:53.530071 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.530037    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"]
Nov 01 04:33:53.533718 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.533692    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt"]
Nov 01 04:33:53.967881 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:53.967838    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-865066/distinct-2-w2-865066-kserve-5fb86fc88c-n9cnt" podUID="4f93737e-433c-4f70-b7e8-179a110cd2b3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.72:8000/ready\": context deadline exceeded"
Nov 01 04:33:55.372710 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:33:55.372676    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f93737e-433c-4f70-b7e8-179a110cd2b3" path="/var/lib/kubelet/pods/4f93737e-433c-4f70-b7e8-179a110cd2b3/volumes"
Nov 01 04:34:00.698599 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:00.698562    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"]
Nov 01 04:34:00.699050 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:00.698739    5529 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf" podUID="900cf90d-b8f8-4b80-bdfb-9f34552d7677" containerName="maas-api" containerID="cri-o://ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835" gracePeriod=30
Nov 01 04:34:00.854460 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:00.854418    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:00.947917 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:00.947882    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 04:34:01.063298 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.063202    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/900cf90d-b8f8-4b80-bdfb-9f34552d7677-kube-api-access-dk6zj\" (UniqueName: \"kubernetes.io/projected/900cf90d-b8f8-4b80-bdfb-9f34552d7677-kube-api-access-dk6zj\") pod \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") "
Nov 01 04:34:01.063298 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.063266    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-metrics-certs\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-metrics-certs\") pod \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") "
Nov 01 04:34:01.063540 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.063354    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls\") pod \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") "
Nov 01 04:34:01.063540 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.063394    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/900cf90d-b8f8-4b80-bdfb-9f34552d7677-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/900cf90d-b8f8-4b80-bdfb-9f34552d7677-openshift-service-ca\") pod \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\" (UID: \"900cf90d-b8f8-4b80-bdfb-9f34552d7677\") "
Nov 01 04:34:01.064019 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.063974    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/900cf90d-b8f8-4b80-bdfb-9f34552d7677-openshift-service-ca" pod "900cf90d-b8f8-4b80-bdfb-9f34552d7677" (UID: "900cf90d-b8f8-4b80-bdfb-9f34552d7677"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:34:01.066115 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.066067    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls" pod "900cf90d-b8f8-4b80-bdfb-9f34552d7677" (UID: "900cf90d-b8f8-4b80-bdfb-9f34552d7677"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:34:01.066115 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.066094    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-metrics-certs" pod "900cf90d-b8f8-4b80-bdfb-9f34552d7677" (UID: "900cf90d-b8f8-4b80-bdfb-9f34552d7677"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 01 04:34:01.066341 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.066207    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/900cf90d-b8f8-4b80-bdfb-9f34552d7677-kube-api-access-dk6zj" pod "900cf90d-b8f8-4b80-bdfb-9f34552d7677" (UID: "900cf90d-b8f8-4b80-bdfb-9f34552d7677"). InnerVolumeSpecName "kube-api-access-dk6zj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:34:01.164654 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.164610    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk6zj\" (UniqueName: \"kubernetes.io/projected/900cf90d-b8f8-4b80-bdfb-9f34552d7677-kube-api-access-dk6zj\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:34:01.164654 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.164647    5529 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-metrics-certs\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:34:01.164654 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.164662    5529 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/900cf90d-b8f8-4b80-bdfb-9f34552d7677-maas-api-tls\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:34:01.164896 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.164677    5529 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/900cf90d-b8f8-4b80-bdfb-9f34552d7677-openshift-service-ca\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:34:01.415522 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.415486    5529 generic.go:356] "Generic (PLEG): container finished" podID="900cf90d-b8f8-4b80-bdfb-9f34552d7677" containerID="ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835" exitCode=0
Nov 01 04:34:01.415836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.415530    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"
Nov 01 04:34:01.415836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.415568    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf" event={"ID":"900cf90d-b8f8-4b80-bdfb-9f34552d7677","Type":"ContainerDied","Data":"ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835"}
Nov 01 04:34:01.415836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.415623    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf" event={"ID":"900cf90d-b8f8-4b80-bdfb-9f34552d7677","Type":"ContainerDied","Data":"5d32c76b5bd8e322b731e04ac8e568ba8a81d85530ef9221f213d52be2f264b7"}
Nov 01 04:34:01.415836 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.415649    5529 scope.go:122] "RemoveContainer" containerID="ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835"
Nov 01 04:34:01.427070 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.427041    5529 scope.go:122] "RemoveContainer" containerID="ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835"
Nov 01 04:34:01.427404 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:34:01.427382    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835\": container with ID starting with ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835 not found: ID does not exist" containerID="ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835"
Nov 01 04:34:01.427491 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.427418    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835"} err="failed to get container status \"ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835\": rpc error: code = NotFound desc = could not find container \"ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835\": container with ID starting with ff12d7f1db6893d8aa858b8dbc1439f5761e587afed4fa21de1eb015ee1b4835 not found: ID does not exist"
Nov 01 04:34:01.581600 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.581566    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"]
Nov 01 04:34:01.586320 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:01.586288    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-865066-7fbb6b4884-6gdqf"]
Nov 01 04:34:02.429017 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:02.428987    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:02.721921 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:02.721843    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:03.292100 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:03.292065    5529 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk" podUID="36feab29-2aec-4575-9239-e821865b9336" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 01 04:34:03.372377 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:03.372341    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="900cf90d-b8f8-4b80-bdfb-9f34552d7677" path="/var/lib/kubelet/pods/900cf90d-b8f8-4b80-bdfb-9f34552d7677/volumes"
Nov 01 04:34:04.432419 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:04.432388    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:09.784409 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:09.784324    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:09.990088 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:09.990054    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:10.129942 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.129917    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 04:34:10.193882 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.193847    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:10.255677 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.255641    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36feab29-2aec-4575-9239-e821865b9336-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36feab29-2aec-4575-9239-e821865b9336-plugins-config-volume\") pod \"36feab29-2aec-4575-9239-e821865b9336\" (UID: \"36feab29-2aec-4575-9239-e821865b9336\") "
Nov 01 04:34:10.255849 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.255775    5529 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36feab29-2aec-4575-9239-e821865b9336-kube-api-access-6jmcd\" (UniqueName: \"kubernetes.io/projected/36feab29-2aec-4575-9239-e821865b9336-kube-api-access-6jmcd\") pod \"36feab29-2aec-4575-9239-e821865b9336\" (UID: \"36feab29-2aec-4575-9239-e821865b9336\") "
Nov 01 04:34:10.256126 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.256097    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36feab29-2aec-4575-9239-e821865b9336-plugins-config-volume" pod "36feab29-2aec-4575-9239-e821865b9336" (UID: "36feab29-2aec-4575-9239-e821865b9336"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 01 04:34:10.258043 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.258015    5529 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36feab29-2aec-4575-9239-e821865b9336-kube-api-access-6jmcd" pod "36feab29-2aec-4575-9239-e821865b9336" (UID: "36feab29-2aec-4575-9239-e821865b9336"). InnerVolumeSpecName "kube-api-access-6jmcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 01 04:34:10.356890 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.356804    5529 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jmcd\" (UniqueName: \"kubernetes.io/projected/36feab29-2aec-4575-9239-e821865b9336-kube-api-access-6jmcd\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:34:10.356890 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.356834    5529 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36feab29-2aec-4575-9239-e821865b9336-plugins-config-volume\") on node \"ip-10-0-136-214.us-west-2.compute.internal\" DevicePath \"\""
Nov 01 04:34:10.465522 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.465488    5529 generic.go:356] "Generic (PLEG): container finished" podID="36feab29-2aec-4575-9239-e821865b9336" containerID="0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348" exitCode=0
Nov 01 04:34:10.465705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.465534    5529 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"
Nov 01 04:34:10.465705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.465568    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk" event={"ID":"36feab29-2aec-4575-9239-e821865b9336","Type":"ContainerDied","Data":"0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348"}
Nov 01 04:34:10.465705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.465616    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk" event={"ID":"36feab29-2aec-4575-9239-e821865b9336","Type":"ContainerDied","Data":"9b0eb863ebcd7ada549333b48cd397e959067f068ffe70c4e4f591a9b5d22d4b"}
Nov 01 04:34:10.465705 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.465644    5529 scope.go:122] "RemoveContainer" containerID="0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348"
Nov 01 04:34:10.475346 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.475330    5529 scope.go:122] "RemoveContainer" containerID="0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348"
Nov 01 04:34:10.475603 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:34:10.475586    5529 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348\": container with ID starting with 0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348 not found: ID does not exist" containerID="0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348"
Nov 01 04:34:10.475667 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.475615    5529 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348"} err="failed to get container status \"0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348\": rpc error: code = NotFound desc = could not find container \"0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348\": container with ID starting with 0aec4cde9b28a0f7d8edc7bc461295ed6f9d413959c7db87dbc7b30e5661e348 not found: ID does not exist"
Nov 01 04:34:10.630442 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.630397    5529 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"]
Nov 01 04:34:10.634929 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:10.634902    5529 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-865066-7f97465495-rjlfk"]
Nov 01 04:34:11.371768 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:11.371733    5529 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36feab29-2aec-4575-9239-e821865b9336" path="/var/lib/kubelet/pods/36feab29-2aec-4575-9239-e821865b9336/volumes"
Nov 01 04:34:12.019545 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:12.019514    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-sbxm2_a8c56eb0-d56d-48ff-855c-e745490e3112/kuadrant-console-plugin/0.log"
Nov 01 04:34:13.062671 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:13.062633    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-frcz5_46bfd00e-97e8-4058-b808-418b76b6dc3b/manager/0.log"
Nov 01 04:34:13.668378 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:13.668348    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-9bqsl_76ea97fd-b3bf-44b7-bf14-7ff151a0122a/manager/0.log"
Nov 01 04:34:14.283095 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:34:14.283056    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:34:14.695293 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:14.695244    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-cvk8n_5d07b79b-0032-4ba2-bb58-cadc2f614a42/manager/0.log"
Nov 01 04:34:15.059498 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:15.058970    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:15.145750 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:15.145721    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-ccqmz_01df910f-c412-4b66-a145-167a59925320/manager/0.log"
Nov 01 04:34:15.270041 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:15.270008    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:15.513303 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:15.513271    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/1.log"
Nov 01 04:34:15.527812 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:15.527766    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:15.737380 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:15.737345    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-5md5f_c808fe4c-9011-4215-b745-782fc10d9038/server/0.log"
Nov 01 04:34:15.956041 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:15.956008    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-v2v7m_95fe89fb-e7f0-41c7-bd20-5b9ff325b600/manager/0.log"
Nov 01 04:34:16.665047 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:16.665017    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/0.log"
Nov 01 04:34:18.557840 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:18.557810    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:21.123900 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:21.123862    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:27.571443 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:27.571411    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-cvk8n_5d07b79b-0032-4ba2-bb58-cadc2f614a42/manager/0.log"
Nov 01 04:34:28.035827 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:28.035788    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-ccqmz_01df910f-c412-4b66-a145-167a59925320/manager/0.log"
Nov 01 04:34:28.395275 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:28.395243    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/1.log"
Nov 01 04:34:28.647515 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:28.647443    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-5md5f_c808fe4c-9011-4215-b745-782fc10d9038/server/0.log"
Nov 01 04:34:28.695707 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:28.695672    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:28.874132 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:28.874104    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-v2v7m_95fe89fb-e7f0-41c7-bd20-5b9ff325b600/manager/0.log"
Nov 01 04:34:29.608279 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:29.608254    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/0.log"
Nov 01 04:34:34.120326 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:34.120297    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-sbxm2_a8c56eb0-d56d-48ff-855c-e745490e3112/kuadrant-console-plugin/0.log"
Nov 01 04:34:34.888204 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:34.888152    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-frcz5_46bfd00e-97e8-4058-b808-418b76b6dc3b/manager/0.log"
Nov 01 04:34:35.328664 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:35.328586    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-9bqsl_76ea97fd-b3bf-44b7-bf14-7ff151a0122a/manager/0.log"
Nov 01 04:34:36.547998 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:36.547970    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f668977d-rxr8s_50148341-de5c-44cc-bb4f-a843515103c3/kube-auth-proxy/0.log"
Nov 01 04:34:44.283009 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:34:44.282960    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:34:49.276186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.276129    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:49.471519 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.471480    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:49.729644 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.729604    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:49.767158 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767124    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jth2x/must-gather-wdh9r"]
Nov 01 04:34:49.767491 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767478    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f5c26be4-de55-4802-8e90-267eb51ba055" containerName="maas-api"
Nov 01 04:34:49.767535 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767493    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5c26be4-de55-4802-8e90-267eb51ba055" containerName="maas-api"
Nov 01 04:34:49.767535 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767505    5529 cpu_manager.go:414] "containerMap: removing container" podUID="4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" containerName="main"
Nov 01 04:34:49.767535 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767511    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" containerName="main"
Nov 01 04:34:49.767535 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767521    5529 cpu_manager.go:414] "containerMap: removing container" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" containerName="main"
Nov 01 04:34:49.767535 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767526    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" containerName="main"
Nov 01 04:34:49.767535 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767535    5529 cpu_manager.go:414] "containerMap: removing container" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767540    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767549    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerName="main"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767554    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerName="main"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767561    5529 cpu_manager.go:414] "containerMap: removing container" podUID="1dfc6927-b1e8-4b84-a9b7-df730fdffc5a" containerName="payload-pre-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767565    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1dfc6927-b1e8-4b84-a9b7-df730fdffc5a" containerName="payload-pre-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767572    5529 cpu_manager.go:414] "containerMap: removing container" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767577    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767582    5529 cpu_manager.go:414] "containerMap: removing container" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767587    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767593    5529 cpu_manager.go:414] "containerMap: removing container" podUID="900cf90d-b8f8-4b80-bdfb-9f34552d7677" containerName="maas-api"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767597    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="900cf90d-b8f8-4b80-bdfb-9f34552d7677" containerName="maas-api"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767605    5529 cpu_manager.go:414] "containerMap: removing container" podUID="5de9edb2-43c4-4215-a436-e7d98eb2815f" containerName="maas-api"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767609    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5de9edb2-43c4-4215-a436-e7d98eb2815f" containerName="maas-api"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767615    5529 cpu_manager.go:414] "containerMap: removing container" podUID="2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" containerName="payload-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767620    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" containerName="payload-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767625    5529 cpu_manager.go:414] "containerMap: removing container" podUID="a051d661-123d-439f-aa76-fc5fea5d4c1c" containerName="payload-pre-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767630    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a051d661-123d-439f-aa76-fc5fea5d4c1c" containerName="payload-pre-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767643    5529 cpu_manager.go:414] "containerMap: removing container" podUID="36feab29-2aec-4575-9239-e821865b9336" containerName="payload-pre-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767647    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36feab29-2aec-4575-9239-e821865b9336" containerName="payload-pre-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767662    5529 cpu_manager.go:414] "containerMap: removing container" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767666    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767673    5529 cpu_manager.go:414] "containerMap: removing container" podUID="e53644f9-dd7a-48a7-bf11-e208d7d9a64f" containerName="maas-api"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767677    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e53644f9-dd7a-48a7-bf11-e208d7d9a64f" containerName="maas-api"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767682    5529 cpu_manager.go:414] "containerMap: removing container" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767686    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767693    5529 cpu_manager.go:414] "containerMap: removing container" podUID="4f93737e-433c-4f70-b7e8-179a110cd2b3" containerName="main"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767697    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f93737e-433c-4f70-b7e8-179a110cd2b3" containerName="main"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767707    5529 cpu_manager.go:414] "containerMap: removing container" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767711    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767717    5529 cpu_manager.go:414] "containerMap: removing container" podUID="07739fcc-12ec-471b-a529-750e9c43bc47" containerName="payload-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767721    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07739fcc-12ec-471b-a529-750e9c43bc47" containerName="payload-processing"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767730    5529 cpu_manager.go:414] "containerMap: removing container" podUID="9ece915b-a3f4-4895-a369-f92415229cde" containerName="main"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767734    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ece915b-a3f4-4895-a369-f92415229cde" containerName="main"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767742    5529 cpu_manager.go:414] "containerMap: removing container" podUID="631fedf5-539d-4417-a412-c053e045d00f" containerName="revoke-keys"
Nov 01 04:34:49.767738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767746    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="631fedf5-539d-4417-a412-c053e045d00f" containerName="revoke-keys"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767798    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="b49f3a8c-500e-45a7-bbdd-dc0816028af4" containerName="istio-proxy"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767808    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="f12a8a8a-d0d8-4753-a64d-b005d2d10943" containerName="main"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767814    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="1dfc6927-b1e8-4b84-a9b7-df730fdffc5a" containerName="payload-pre-processing"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767820    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767825    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767830    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="900cf90d-b8f8-4b80-bdfb-9f34552d7677" containerName="maas-api"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767836    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="5de9edb2-43c4-4215-a436-e7d98eb2815f" containerName="maas-api"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767841    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ca6e3d4-6fbd-4fe3-96eb-1ed70ab85568" containerName="payload-processing"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767847    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="a051d661-123d-439f-aa76-fc5fea5d4c1c" containerName="payload-pre-processing"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767853    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="36feab29-2aec-4575-9239-e821865b9336" containerName="payload-pre-processing"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767860    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="f56100d9-ce5d-4755-bf06-5911d7d0d221" containerName="main"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767864    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="e53644f9-dd7a-48a7-bf11-e208d7d9a64f" containerName="maas-api"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767869    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="c9aedecf-18d9-4332-ac97-5491bd761f51" containerName="istio-proxy"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767873    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f93737e-433c-4f70-b7e8-179a110cd2b3" containerName="main"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767880    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd194c0c-7c9f-4b6b-a4dc-838cc6b7da93" containerName="istio-proxy"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767884    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="07739fcc-12ec-471b-a529-750e9c43bc47" containerName="payload-processing"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767889    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ece915b-a3f4-4895-a369-f92415229cde" containerName="main"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767894    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="631fedf5-539d-4417-a412-c053e045d00f" containerName="revoke-keys"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767899    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5c26be4-de55-4802-8e90-267eb51ba055" containerName="maas-api"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767904    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="4adbbde8-f3b5-4f17-8d75-dbe3c80b1948" containerName="main"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767908    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="976129b2-49b6-4c5f-881b-c7210355fc30" containerName="main"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767961    5529 cpu_manager.go:414] "containerMap: removing container" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.767966    5529 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.768833 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.768026    5529 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f8585ec-6d27-43ee-93c6-134c1b2df31f" containerName="cleanup"
Nov 01 04:34:49.771157 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.771135    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jth2x/must-gather-wdh9r"
Nov 01 04:34:49.829810 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.829780    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jth2x/must-gather-wdh9r"]
Nov 01 04:34:49.878411 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.878379    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jth2x\"/\"kube-root-ca.crt\""
Nov 01 04:34:49.878592 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.878528    5529 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jth2x\"/\"openshift-service-ca.crt\""
Nov 01 04:34:49.878592 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.878552    5529 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jth2x\"/\"default-dockercfg-j7x5g\""
Nov 01 04:34:49.895299 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.895270    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chsrv\" (UniqueName: \"kubernetes.io/projected/a11bb13d-21df-4796-bd92-df1c5e6c0b07-kube-api-access-chsrv\") pod \"must-gather-wdh9r\" (UID: \"a11bb13d-21df-4796-bd92-df1c5e6c0b07\") " pod="openshift-must-gather-jth2x/must-gather-wdh9r"
Nov 01 04:34:49.895539 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.895304    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a11bb13d-21df-4796-bd92-df1c5e6c0b07-must-gather-output\") pod \"must-gather-wdh9r\" (UID: \"a11bb13d-21df-4796-bd92-df1c5e6c0b07\") " pod="openshift-must-gather-jth2x/must-gather-wdh9r"
Nov 01 04:34:49.928139 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.928114    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:49.996253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.996151    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chsrv\" (UniqueName: \"kubernetes.io/projected/a11bb13d-21df-4796-bd92-df1c5e6c0b07-kube-api-access-chsrv\") pod \"must-gather-wdh9r\" (UID: \"a11bb13d-21df-4796-bd92-df1c5e6c0b07\") " pod="openshift-must-gather-jth2x/must-gather-wdh9r"
Nov 01 04:34:49.996253 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.996210    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a11bb13d-21df-4796-bd92-df1c5e6c0b07-must-gather-output\") pod \"must-gather-wdh9r\" (UID: \"a11bb13d-21df-4796-bd92-df1c5e6c0b07\") " pod="openshift-must-gather-jth2x/must-gather-wdh9r"
Nov 01 04:34:49.996618 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:49.996594    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a11bb13d-21df-4796-bd92-df1c5e6c0b07-must-gather-output\") pod \"must-gather-wdh9r\" (UID: \"a11bb13d-21df-4796-bd92-df1c5e6c0b07\") " pod="openshift-must-gather-jth2x/must-gather-wdh9r"
Nov 01 04:34:50.057479 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:50.057450    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chsrv\" (UniqueName: \"kubernetes.io/projected/a11bb13d-21df-4796-bd92-df1c5e6c0b07-kube-api-access-chsrv\") pod \"must-gather-wdh9r\" (UID: \"a11bb13d-21df-4796-bd92-df1c5e6c0b07\") " pod="openshift-must-gather-jth2x/must-gather-wdh9r"
Nov 01 04:34:50.085400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:50.085363    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jth2x/must-gather-wdh9r"
Nov 01 04:34:50.457567 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:50.457537    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jth2x/must-gather-wdh9r"]
Nov 01 04:34:50.460681 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:34:50.460651    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda11bb13d_21df_4796_bd92_df1c5e6c0b07.slice/crio-0081c949817d8e8556cddcf6863ccd9817b155364e53dea71bf98b64069b7263 WatchSource:0}: Error finding container 0081c949817d8e8556cddcf6863ccd9817b155364e53dea71bf98b64069b7263: Status 404 returned error can't find the container with id 0081c949817d8e8556cddcf6863ccd9817b155364e53dea71bf98b64069b7263
Nov 01 04:34:50.462498 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:50.462476    5529 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 01 04:34:50.685084 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:50.685052    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jth2x/must-gather-wdh9r" event={"ID":"a11bb13d-21df-4796-bd92-df1c5e6c0b07","Type":"ContainerStarted","Data":"0081c949817d8e8556cddcf6863ccd9817b155364e53dea71bf98b64069b7263"}
Nov 01 04:34:51.524497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:51.524462    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:52.970947 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:52.970892    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:34:56.719025 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:56.718989    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jth2x/must-gather-wdh9r" event={"ID":"a11bb13d-21df-4796-bd92-df1c5e6c0b07","Type":"ContainerStarted","Data":"a9ef7ee44d712926cef2446c9962bfc525a7e5c9b24f1ac0e8146c20a891595b"}
Nov 01 04:34:56.719464 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:56.719039    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jth2x/must-gather-wdh9r" event={"ID":"a11bb13d-21df-4796-bd92-df1c5e6c0b07","Type":"ContainerStarted","Data":"f00913bb35b9dcd132a17e53389a2a0733e96f28f17e49f198f3bfaa5d0d090b"}
Nov 01 04:34:56.834640 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:34:56.834588    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-jth2x/must-gather-wdh9r" podStartSLOduration=2.662124328 podStartE2EDuration="7.834574641s" totalImagesPullingTime="5.172450313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-01 04:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:34:56.834241971 +0000 UTC m=+3117.593969765" watchObservedRunningTime="2026-11-01 04:34:56.834574641 +0000 UTC m=+3117.594302436"
Nov 01 04:35:01.485286 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:01.485258    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-cvk8n_5d07b79b-0032-4ba2-bb58-cadc2f614a42/manager/0.log"
Nov 01 04:35:02.165795 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:02.165765    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m67pw_c8c13245-bedc-4277-8989-8c585941e3c0/global-pull-secret-syncer/0.log"
Nov 01 04:35:02.320514 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:02.320476    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-ccqmz_01df910f-c412-4b66-a145-167a59925320/manager/0.log"
Nov 01 04:35:02.431573 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:02.431486    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/0.log"
Nov 01 04:35:02.655040 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:02.651355    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/1.log"
Nov 01 04:35:02.777015 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:02.770326    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-5md5f_c808fe4c-9011-4215-b745-782fc10d9038/server/0.log"
Nov 01 04:35:02.988588 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:02.988555    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-v2v7m_95fe89fb-e7f0-41c7-bd20-5b9ff325b600/manager/0.log"
Nov 01 04:35:04.905186 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:04.904681    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log"
Nov 01 04:35:06.404599 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:06.404572    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-cvk8n_5d07b79b-0032-4ba2-bb58-cadc2f614a42/manager/0.log"
Nov 01 04:35:06.819787 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:06.819703    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-214.us-west-2.compute.internal_67398c77b717adfae75e6234ca803488/haproxy/0.log"
Nov 01 04:35:07.054022 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:07.053988    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-ccqmz_01df910f-c412-4b66-a145-167a59925320/manager/0.log"
Nov 01 04:35:07.185963 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:07.185930    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/0.log"
Nov 01 04:35:07.338609 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:07.338536    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/1.log"
Nov 01 04:35:07.457911 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:07.457831    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-5md5f_c808fe4c-9011-4215-b745-782fc10d9038/server/0.log"
Nov 01 04:35:07.670480 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:07.670449    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-v2v7m_95fe89fb-e7f0-41c7-bd20-5b9ff325b600/manager/0.log"
Nov 01 04:35:10.894023 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:10.892368    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-cvk8n_5d07b79b-0032-4ba2-bb58-cadc2f614a42/manager/0.log"
Nov 01 04:35:11.537016 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:11.536977    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-ccqmz_01df910f-c412-4b66-a145-167a59925320/manager/0.log"
Nov 01 04:35:11.658657 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:11.658622    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/0.log"
Nov 01 04:35:11.802265 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:11.802156    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686485556-8hwrr_487a402a-8513-43c4-a5cb-12a007b26860/manager/1.log"
Nov 01 04:35:11.919750 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:11.919720    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-5md5f_c808fe4c-9011-4215-b745-782fc10d9038/server/0.log"
Nov 01 04:35:12.140470 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:12.140438    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-v2v7m_95fe89fb-e7f0-41c7-bd20-5b9ff325b600/manager/0.log"
Nov 01 04:35:12.993353 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:12.993317    5529 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"]
Nov 01 04:35:13.003263 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.003235    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.077800 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.077769    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"]
Nov 01 04:35:13.170981 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.170941    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-proc\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.170981 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.170986    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-sys\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.171282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.171072    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkntb\" (UniqueName: \"kubernetes.io/projected/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-kube-api-access-zkntb\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.171282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.171110    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-lib-modules\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.171282 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.171214    5529 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-podres\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272132 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272046    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-proc\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272132 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272086    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-sys\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272132 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272112    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkntb\" (UniqueName: \"kubernetes.io/projected/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-kube-api-access-zkntb\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272144    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-lib-modules\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272191    5529 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-podres\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272209    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-sys\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272209    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-proc\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272286    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-podres\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.272395 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.272357    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-lib-modules\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.334180 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.334122    5529 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkntb\" (UniqueName: \"kubernetes.io/projected/2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1-kube-api-access-zkntb\") pod \"perf-node-gather-daemonset-sxk9h\" (UID: \"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1\") " pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.616984 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.616895    5529 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:13.701964 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.701937    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-sbxm2_a8c56eb0-d56d-48ff-855c-e745490e3112/kuadrant-console-plugin/0.log"
Nov 01 04:35:13.995934 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:13.995716    5529 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"]
Nov 01 04:35:13.998790 ip-10-0-136-214 kubenswrapper[5529]: W1101 04:35:13.998743    5529 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2f20a92a_88c8_4a24_b2c8_18d0ce8af3c1.slice/crio-d0716e685aa8a0ddf0e0b36c39e6524e695777d60edd30b62c1826bf2094bf3b WatchSource:0}: Error finding container d0716e685aa8a0ddf0e0b36c39e6524e695777d60edd30b62c1826bf2094bf3b: Status 404 returned error can't find the container with id d0716e685aa8a0ddf0e0b36c39e6524e695777d60edd30b62c1826bf2094bf3b
Nov 01 04:35:14.293855 ip-10-0-136-214 kubenswrapper[5529]: E1101 04:35:14.293723    5529 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-bdn62" containerName="extractor"
Nov 01 04:35:14.591068 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:14.590973    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-frcz5_46bfd00e-97e8-4058-b808-418b76b6dc3b/manager/0.log"
Nov 01 04:35:14.880357 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:14.880323    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h" event={"ID":"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1","Type":"ContainerStarted","Data":"7744592e9328eb1895b3e54a6c43b51a24ee599fc8b5703c6812fb90e8ebcfe0"}
Nov 01 04:35:14.880571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:14.880407    5529 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h" event={"ID":"2f20a92a-88c8-4a24-b2c8-18d0ce8af3c1","Type":"ContainerStarted","Data":"d0716e685aa8a0ddf0e0b36c39e6524e695777d60edd30b62c1826bf2094bf3b"}
Nov 01 04:35:14.880571 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:14.880442    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:14.998501 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:14.998442    5529 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h" podStartSLOduration=2.998427429 podStartE2EDuration="2.998427429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-01 04:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-01 04:35:14.996801414 +0000 UTC m=+3135.756529210" watchObservedRunningTime="2026-11-01 04:35:14.998427429 +0000 UTC m=+3135.758155202"
Nov 01 04:35:15.324497 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:15.324394    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-9bqsl_76ea97fd-b3bf-44b7-bf14-7ff151a0122a/manager/0.log"
Nov 01 04:35:17.819814 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:17.819780    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93da4576-fc49-4c08-8105-bcc0e81ea27a/alertmanager/0.log"
Nov 01 04:35:18.214270 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:18.214243    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93da4576-fc49-4c08-8105-bcc0e81ea27a/config-reloader/0.log"
Nov 01 04:35:18.608785 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:18.608712    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93da4576-fc49-4c08-8105-bcc0e81ea27a/kube-rbac-proxy-web/0.log"
Nov 01 04:35:18.903786 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:18.903756    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:35:19.003173 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:19.003133    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93da4576-fc49-4c08-8105-bcc0e81ea27a/kube-rbac-proxy/0.log"
Nov 01 04:35:19.396942 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:19.396916    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93da4576-fc49-4c08-8105-bcc0e81ea27a/kube-rbac-proxy-metric/0.log"
Nov 01 04:35:19.796050 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:19.795980    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93da4576-fc49-4c08-8105-bcc0e81ea27a/prom-label-proxy/0.log"
Nov 01 04:35:20.191633 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:20.191593    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_93da4576-fc49-4c08-8105-bcc0e81ea27a/init-config-reloader/0.log"
Nov 01 04:35:20.497548 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:20.497458    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f668977d-rxr8s_50148341-de5c-44cc-bb4f-a843515103c3/kube-auth-proxy/0.log"
Nov 01 04:35:20.895421 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:20.895392    5529 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jth2x/perf-node-gather-daemonset-sxk9h"
Nov 01 04:35:22.184559 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:22.184524    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86b5876bbc-85f92_5f4fd259-d210-48c2-a14a-d29656a3aa34/metrics-server/0.log"
Nov 01 04:35:22.583278 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:22.583157    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-6c6fj_2ca80b40-dc5f-479b-b73c-4683cd09c83a/monitoring-plugin/0.log"
Nov 01 04:35:25.392323 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:25.392292    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rjnsj_9b725795-a5f2-4b23-9429-d0bb34b56251/node-exporter/0.log"
Nov 01 04:35:25.797083 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:25.796986    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rjnsj_9b725795-a5f2-4b23-9429-d0bb34b56251/kube-rbac-proxy/0.log"
Nov 01 04:35:26.192349 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:26.192317    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rjnsj_9b725795-a5f2-4b23-9429-d0bb34b56251/init-textfile/0.log"
Nov 01 04:35:27.128400 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:27.128374    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-sbxm2_a8c56eb0-d56d-48ff-855c-e745490e3112/kuadrant-console-plugin/0.log"
Nov 01 04:35:27.851753 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:27.851717    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bd0c5f5-a794-4d20-b439-262ad4704f8a/prometheus/0.log"
Nov 01 04:35:27.861038 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:27.861006    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-frcz5_46bfd00e-97e8-4058-b808-418b76b6dc3b/manager/0.log"
Nov 01 04:35:28.256258 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:28.256207    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bd0c5f5-a794-4d20-b439-262ad4704f8a/config-reloader/0.log"
Nov 01 04:35:28.274247 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:28.274215    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-9bqsl_76ea97fd-b3bf-44b7-bf14-7ff151a0122a/manager/0.log"
Nov 01 04:35:28.649574 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:28.649552    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bd0c5f5-a794-4d20-b439-262ad4704f8a/thanos-sidecar/0.log"
Nov 01 04:35:29.042829 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:29.042747    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bd0c5f5-a794-4d20-b439-262ad4704f8a/kube-rbac-proxy-web/0.log"
Nov 01 04:35:29.052519 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:29.052495    5529 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gmh92_ecef226e-8496-4a01-9903-2ecd046af47e/konnectivity-agent/0.log" limit=1024
Nov 01 04:35:29.441028 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:29.441005    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bd0c5f5-a794-4d20-b439-262ad4704f8a/kube-rbac-proxy/0.log"
Nov 01 04:35:29.835377 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:29.835304    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bd0c5f5-a794-4d20-b439-262ad4704f8a/kube-rbac-proxy-thanos/0.log"
Nov 01 04:35:30.229324 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:30.229294    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bd0c5f5-a794-4d20-b439-262ad4704f8a/init-config-reloader/0.log"
Nov 01 04:35:33.031738 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:33.031709    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f4d9d979-knqfv_5f580cb7-edb1-4422-b86b-947fea4f1c5c/thanos-query/0.log"
Nov 01 04:35:33.425193 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:33.425141    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f4d9d979-knqfv_5f580cb7-edb1-4422-b86b-947fea4f1c5c/kube-rbac-proxy-web/0.log"
Nov 01 04:35:33.820248 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:33.820106    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f4d9d979-knqfv_5f580cb7-edb1-4422-b86b-947fea4f1c5c/kube-rbac-proxy/0.log"
Nov 01 04:35:34.219791 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:34.219760    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f4d9d979-knqfv_5f580cb7-edb1-4422-b86b-947fea4f1c5c/prom-label-proxy/0.log"
Nov 01 04:35:34.616354 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:34.616254    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f4d9d979-knqfv_5f580cb7-edb1-4422-b86b-947fea4f1c5c/kube-rbac-proxy-rules/0.log"
Nov 01 04:35:35.010385 ip-10-0-136-214 kubenswrapper[5529]: I1101 04:35:35.010356    5529 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74f4d9d979-knqfv_5f580cb7-edb1-4422-b86b-947fea4f1c5c/kube-rbac-proxy-metrics/0.log"