Jul 08 01:42:16.268191 ip-10-0-138-104 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.710013    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717768    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717780    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717784    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717787    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717791    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717793    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717798    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 01:42:16.734452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717801    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717804    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717807    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717809    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717812    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717822    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717825    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717828    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717830    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717833    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717836    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717838    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717841    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717843    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717846    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717860    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717863    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717866    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717868    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717871    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 01:42:16.738977 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717874    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717877    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717879    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717882    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717885    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717888    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717890    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717893    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717896    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717898    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717901    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717903    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717906    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717908    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717912    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717916    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717931    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717934    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717937    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717939    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 01:42:16.743060 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717942    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717945    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717947    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717950    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717953    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717956    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717958    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717961    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717964    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717967    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717972    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717976    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717980    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717983    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717986    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717989    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717992    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.717997    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 01:42:16.746358 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718001    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718004    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718006    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718009    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718012    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718016    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718020    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718023    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718026    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718029    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718032    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718035    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718038    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718041    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718043    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718046    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718049    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718051    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718054    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 01:42:16.750029 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718056    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718059    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718061    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718064    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718067    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718069    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718072    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718074    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718077    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718080    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718083    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718085    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718089    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718092    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718095    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718784    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718791    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718794    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718797    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718799    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 01:42:16.762797 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718802    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718805    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718807    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718810    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718813    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718815    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718818    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718821    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718823    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718826    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718828    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718831    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718834    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718837    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718840    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718843    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718845    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718848    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718851    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718853    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 01:42:16.766319 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718856    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718858    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718861    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718863    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718866    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718869    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718872    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718875    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718877    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718880    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718882    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718885    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718887    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718890    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718892    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718894    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718897    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718900    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718903    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718905    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 01:42:16.769696 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718908    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718911    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718913    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718916    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718936    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718939    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718943    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718946    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718948    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718951    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718954    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718956    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718959    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718963    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718966    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718968    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718973    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718977    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718981    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 01:42:16.774542 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718985    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718988    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718991    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718994    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.718998    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719002    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719006    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719009    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719012    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719014    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719017    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719020    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719023    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719025    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719029    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719032    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719035    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719037    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719040    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 01:42:16.782767 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719042    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719045    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719048    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719050    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719053    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719055    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719058    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719060    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719063    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719066    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719069    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719071    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719074    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719077    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719080    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719082    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719478    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719483    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719486    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719489    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 01:42:16.787464 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719492    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719495    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719497    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719500    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719502    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719505    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719508    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719511    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719514    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719516    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719519    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719522    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719524    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719527    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719530    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719533    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719535    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719538    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719541    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 01:42:16.795208 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719544    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719546    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719549    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719551    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719554    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719556    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719560    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719569    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719572    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719576    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719580    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719583    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719586    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719588    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719591    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719594    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719597    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719600    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719602    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 01:42:16.799694 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719605    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719608    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719611    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719615    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719619    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719622    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719624    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719627    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719630    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719632    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719636    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719655    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719660    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719667    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719671    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719674    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719676    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719679    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719682    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719684    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 01:42:16.811271 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719687    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 01:42:16.800611 ip-10-0-138-104 systemd[1]: Started Kubernetes Kubelet.
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719696    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719699    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719702    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719704    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719706    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719709    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719711    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719714    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719716    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719719    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719725    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719727    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719730    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719733    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719735    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719740    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719743    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719746    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 01:42:16.817788 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719749    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719751    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719754    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719757    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719759    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719762    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719766    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719768    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719770    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719773    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719776    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719778    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719781    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719783    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719786    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719794    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719797    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.719799    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719877    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719887    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719907    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 01:42:16.829856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719911    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719915    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719931    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719937    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719941    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719945    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719948    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719951    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719954    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719957    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719960    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719963    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719966    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719969    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719972    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719984    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719987    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719992    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719995    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.719998    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720002    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720005    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720008    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 01:42:16.836966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720011    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720014    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720017    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720020    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720028    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720031    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720035    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720038    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720041    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720044    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720047    2582 flags.go:64] FLAG: --enable-server="true"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720050    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720058    2582 flags.go:64] FLAG: --event-burst="100"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720061    2582 flags.go:64] FLAG: --event-qps="50"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720064    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720067    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720070    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720074    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720077    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720079    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720082    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720085    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720088    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720091    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720094    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 01:42:16.990754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720096    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720101    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720103    2582 flags.go:64] FLAG: --feature-gates=""
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720108    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720111    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720114    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720117    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720120    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720123    2582 flags.go:64] FLAG: --help="false"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720126    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-138-104.ec2.internal"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720128    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720131    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720140    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720143    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720147    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720150    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720152    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720155    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720158    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720162    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720165    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720168    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720171    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720173    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 01:42:17.011378 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720176    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720179    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720182    2582 flags.go:64] FLAG: --lock-file=""
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720184    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720187    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720190    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720195    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720199    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720201    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720205    2582 flags.go:64] FLAG: --logging-format="text"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720208    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720211    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720214    2582 flags.go:64] FLAG: --manifest-url=""
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720217    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720221    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720224    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720228    2582 flags.go:64] FLAG: --max-pods="110"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720231    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720234    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720237    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720239    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720248    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720251    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720254    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720261    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 01:42:17.014560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720264    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720266    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720271    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720274    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720279    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720282    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720285    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720288    2582 flags.go:64] FLAG: --port="10250"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720291    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720294    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0687182c812e9d70a"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720297    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720300    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720303    2582 flags.go:64] FLAG: --register-node="true"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720306    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720309    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720312    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720317    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720319    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720323    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720326    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720329    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720332    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720334    2582 flags.go:64] FLAG: --runonce="false"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720337    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720340    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 01:42:17.015368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720343    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720346    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720349    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720352    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720362    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720365    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720368    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720371    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720374    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720376    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720381    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720384    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720386    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720392    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720395    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720397    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720404    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720406    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720410    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720413    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720416    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720418    2582 flags.go:64] FLAG: --v="2"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720422    2582 flags.go:64] FLAG: --version="false"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720427    2582 flags.go:64] FLAG: --vmodule=""
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720431    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 01:42:17.016180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.720434    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720600    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720604    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720607    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720610    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720612    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720615    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720618    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720620    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720623    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720625    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720628    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720636    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720639    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720641    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720644    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720647    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720650    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720653    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720656    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 01:42:17.016995 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720659    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720661    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720664    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720666    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720669    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720671    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720674    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720676    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720679    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720682    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720685    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720688    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720690    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720693    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720697    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720701    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720704    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720706    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720709    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 01:42:17.018598 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720712    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720714    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720717    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720719    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720722    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720724    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720732    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720735    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720739    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720742    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720745    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720749    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720751    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720754    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720757    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720759    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720762    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720764    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720767    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720770    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 01:42:17.019389 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720772    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720774    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720777    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720781    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720784    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720786    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720789    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720791    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720794    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720796    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720799    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720801    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720804    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720806    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720809    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720812    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720814    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720816    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720819    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720827    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 01:42:17.020988 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720829    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720832    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720836    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720838    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720841    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720844    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720846    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720849    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720851    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720854    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720857    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720860    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720862    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720865    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720868    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720872    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720874    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720877    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720879    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720882    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 01:42:17.021784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.720886    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.721781    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.740836    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.740853    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.740875    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.740881    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740959    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740966    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740969    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740972    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740975    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740978    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740981    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740984    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740987    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 01:42:17.023423 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740990    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740993    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740996    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.740999    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741002    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741004    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741007    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741010    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741013    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741015    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741018    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741021    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741024    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741026    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741029    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741032    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741034    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741038    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741043    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741046    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 01:42:17.024628 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741049    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741051    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741054    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741056    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741059    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741062    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741065    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741068    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741070    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741073    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741076    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741079    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741081    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741085    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741089    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741092    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741095    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741098    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741101    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 01:42:17.026237 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741105    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741108    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741111    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741114    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741117    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741119    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741122    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741125    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741128    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741131    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741134    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741137    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741143    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741148    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741151    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741154    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741157    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741160    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741163    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 01:42:17.027444 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741165    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741168    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741171    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741174    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741176    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741179    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741182    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741184    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741187    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741189    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741192    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741195    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741205    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741212    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741214    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741217    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741220    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741222    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741225    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741228    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 01:42:17.029052 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741230    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741233    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741235    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741238    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741240    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741243    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741245    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741248    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741251    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741253    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741257    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741260    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.741265    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741385    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741391    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 01:42:17.029894 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741394    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741397    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741399    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741403    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741406    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741409    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741413    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741417    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741420    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741423    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741432    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741437    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741439    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741442    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741445    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741447    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741450    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741453    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741455    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 01:42:17.031492 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741458    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741461    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741463    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741466    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741468    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741471    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741473    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741476    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741480    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741482    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741485    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741488    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741490    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741493    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741495    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741498    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741500    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741503    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741505    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741508    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 01:42:17.032279 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741510    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741513    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741515    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741518    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741528    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741531    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741534    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741536    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741539    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741541    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741544    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741547    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741549    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741552    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741554    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741557    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741559    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741563    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741567    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 01:42:17.033085 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741573    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741580    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741583    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741587    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741589    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741592    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741595    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741597    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741600    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741603    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741605    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741607    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741610    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741612    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741615    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741618    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741620    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741624    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741628    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741631    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 01:42:17.033890 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741633    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741635    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741638    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741641    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741643    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741646    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741648    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741651    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741653    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741656    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741658    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741661    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741663    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741667    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741670    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741672    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741675    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741677    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 01:42:17.034673 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:16.741680    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.741685    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.741804    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.744736    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.746202    2582 server.go:1019] "Starting client certificate rotation"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.746307    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.746340    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.749291    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.750805    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.762853    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.765661    2582 log.go:25] "Validated CRI v1 image API"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.766375    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 01:42:17.035489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.770164    2582 fs.go:135] Filesystem UUIDs: map[24ca37da-5c54-47c3-b239-8347f0c84790:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a1fc1abb-65fb-471d-97ad-a75e33be8722:/dev/nvme0n1p4]
Jul 08 01:42:17.035881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.770184    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 01:42:17.035881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.777422    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.778363    2582 manager.go:216] Machine: {Timestamp:2026-07-08 01:42:16.776795608 +0000 UTC m=+0.383414446 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3079907 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f83862aa70072b60cd5e6d6cc0c09 SystemUUID:ec2f8386-2aa7-0072-b60c-d5e6d6cc0c09 BootID:6ab2553f-91e2-493e-b9b1-5879a6720618 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:a7:a0:78:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:a7:a0:78:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:10:59:20:d8:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.778501    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.778613    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.782214    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.782243    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-104.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.783675    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.783689    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.783699    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.784483    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.785990    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789192    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789329    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789358    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789371    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789390    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789403    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789419    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 01:42:17.039948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789828    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.789864    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.792523    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.795067    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.795095    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796372    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796386    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796392    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796398    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796407    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796413    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796421    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796427    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796433    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796440    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796449    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796454    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796478    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.796484    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.799694    2582 server.go:1268] "Started kubelet"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.799802    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.799840    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.799896    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.801705    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.802585    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.804265    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.804275    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-104.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.804309    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.804317    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-104.ec2.internal.18c02d0179beb0ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-104.ec2.internal,UID:ip-10-0-138-104.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-104.ec2.internal,},FirstTimestamp:2026-07-08 01:42:16.799473903 +0000 UTC m=+0.406092739,LastTimestamp:2026-07-08 01:42:16.799473903 +0000 UTC m=+0.406092739,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-104.ec2.internal,}"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.806468    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.809219    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.809225    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.809373    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.813445    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.813459    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.813470    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.813951    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.813964    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.814249    2582 factory.go:55] Registering systemd factory
Jul 08 01:42:17.040703 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.814278    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.814596    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-104.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.814733    2582 factory.go:153] Registering CRI-O factory
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.814746    2582 factory.go:223] Registration of the crio container factory successfully
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.814820    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.814845    2582 factory.go:103] Registering Raw factory
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.814863    2582 manager.go:1196] Started watching for new ooms in manager
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.815308    2582 manager.go:349] Starting recovery of all containers
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.821677    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.822811    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xc94"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.824170    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.826811    2582 manager.go:354] Recovery completed
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.830800    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9xc94"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.831042    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.832746    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.832774    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.832789    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.833337    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.833350    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.833367    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.833342    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.834229    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.834254    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.834264    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.834475    2582 policy_none.go:49] "None policy: Start"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.834488    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.834500    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.835410    2582 policy_none.go:47] "Start"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.862620    2582 manager.go:337] "Starting Device Plugin manager"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.862668    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.862681    2582 server.go:87] "Starting device plugin registration server"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.862938    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.862950    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.863104    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.863519    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.863531    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.863609    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.863662    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.917957    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.917995    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.918018    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.918048    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.920793    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.963950    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.964829    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.964856    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 01:42:17.041945 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.964866    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 01:42:17.044313 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.964887    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-104.ec2.internal"
Jul 08 01:42:17.044313 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:16.975415    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-104.ec2.internal"
Jul 08 01:42:17.044313 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.975434    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-104.ec2.internal\": node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:17.044313 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:16.999439    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.034150 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.034113    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.034150 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.034143    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal"]
Jul 08 01:42:19.034770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.034180    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 01:42:19.034770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.034229    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 01:42:19.034770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.034349    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 01:42:19.035266 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.035251    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 01:42:19.035354 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.035310    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 01:42:19.035354 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.035330    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 01:42:19.037545 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.037530    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 01:42:19.037652 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.037636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.037692 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.037667    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 01:42:19.038234 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.038217    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 01:42:19.038306 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.038244    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 01:42:19.038306 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.038258    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 01:42:19.038306 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.038261    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 01:42:19.038306 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.038278    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 01:42:19.038306 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.038288    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 01:42:19.040429 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.040413    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.040479 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.040441    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 01:42:19.041146 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.041136    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 01:42:19.041214 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.041158    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 01:42:19.041214 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.041168    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeHasSufficientPID"
Jul 08 01:42:19.049758 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.049739    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 01:42:19.068306 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.068288    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-104.ec2.internal\" not found" node="ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.072928 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.072914    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-104.ec2.internal\" not found" node="ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.075979 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.075952    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 01:37:18 +0000 UTC" deadline="2027-12-08 11:48:24.442036488 +0000 UTC"
Jul 08 01:42:19.076025 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.075981    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12442h6m5.366058506s"
Jul 08 01:42:19.135090 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.135029    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.135180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.135087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea9af4086c93b3b0be762c6dc0caca9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"dea9af4086c93b3b0be762c6dc0caca9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.135180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.135109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea9af4086c93b3b0be762c6dc0caca9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"dea9af4086c93b3b0be762c6dc0caca9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.135180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.135130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c6ce3691de19c622d88d1f963379cd4-config\") pod \"kube-apiserver-proxy-ip-10-0-138-104.ec2.internal\" (UID: \"4c6ce3691de19c622d88d1f963379cd4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.235377 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.235345    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.235377 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.235368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea9af4086c93b3b0be762c6dc0caca9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"dea9af4086c93b3b0be762c6dc0caca9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.235584 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.235404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea9af4086c93b3b0be762c6dc0caca9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"dea9af4086c93b3b0be762c6dc0caca9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.235584 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.235426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c6ce3691de19c622d88d1f963379cd4-config\") pod \"kube-apiserver-proxy-ip-10-0-138-104.ec2.internal\" (UID: \"4c6ce3691de19c622d88d1f963379cd4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.235584 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.235475    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c6ce3691de19c622d88d1f963379cd4-config\") pod \"kube-apiserver-proxy-ip-10-0-138-104.ec2.internal\" (UID: \"4c6ce3691de19c622d88d1f963379cd4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.235584 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.235468    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dea9af4086c93b3b0be762c6dc0caca9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"dea9af4086c93b3b0be762c6dc0caca9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.235584 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.235531    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dea9af4086c93b3b0be762c6dc0caca9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal\" (UID: \"dea9af4086c93b3b0be762c6dc0caca9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.336055 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.336010    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.365218 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.365195    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 01:42:19.370356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.370340    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.376030 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.376015    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:19.437201 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.437129    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.538088 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.538059    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.638575 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.638543    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.739148 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.739079    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.839576 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.839546    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.940087 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:19.940059    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-104.ec2.internal\" not found"
Jul 08 01:42:19.971052 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:19.971028    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 01:42:19.998784 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:19.998757    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6ce3691de19c622d88d1f963379cd4.slice/crio-2b6742d391b3cdbafc65de724d478444509d3ded4e9748f51ebde6cfb105d011 WatchSource:0}: Error finding container 2b6742d391b3cdbafc65de724d478444509d3ded4e9748f51ebde6cfb105d011: Status 404 returned error can't find the container with id 2b6742d391b3cdbafc65de724d478444509d3ded4e9748f51ebde6cfb105d011
Jul 08 01:42:20.003410 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.003391    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 01:42:20.009324 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:20.009302    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea9af4086c93b3b0be762c6dc0caca9.slice/crio-b859ec7a3eea54fd56b1bdaab6bc0d46c9799859f5db9c9b796ac840e54b653d WatchSource:0}: Error finding container b859ec7a3eea54fd56b1bdaab6bc0d46c9799859f5db9c9b796ac840e54b653d: Status 404 returned error can't find the container with id b859ec7a3eea54fd56b1bdaab6bc0d46c9799859f5db9c9b796ac840e54b653d
Jul 08 01:42:20.037968 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.037944    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 01:42:20.050964 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.050942    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:20.051081 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.050975    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 01:42:20.061283 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.061259    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 01:42:20.063896 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.063882    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 01:42:20.064929 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.064917    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal"
Jul 08 01:42:20.073205 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.073193    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 01:42:20.082822 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.082801    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cpk2w"
Jul 08 01:42:20.090291 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.090274    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cpk2w"
Jul 08 01:42:20.163602 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.163553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" event={"ID":"dea9af4086c93b3b0be762c6dc0caca9","Type":"ContainerStarted","Data":"b859ec7a3eea54fd56b1bdaab6bc0d46c9799859f5db9c9b796ac840e54b653d"}
Jul 08 01:42:20.164655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:20.164634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" event={"ID":"4c6ce3691de19c622d88d1f963379cd4","Type":"ContainerStarted","Data":"2b6742d391b3cdbafc65de724d478444509d3ded4e9748f51ebde6cfb105d011"}
Jul 08 01:42:21.035288 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.035235    2582 apiserver.go:52] "Watching apiserver"
Jul 08 01:42:21.045011 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.044975    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 01:42:21.045526 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.045501    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2t5qg","openshift-multus/network-metrics-daemon-pv6z5","openshift-network-diagnostics/network-check-target-95trb","openshift-ovn-kubernetes/ovnkube-node-dm8hs","kube-system/global-pull-secret-syncer-cmvbh","kube-system/konnectivity-agent-hbmmr","openshift-cluster-node-tuning-operator/tuned-fj7x9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal","openshift-multus/multus-additional-cni-plugins-g5k5m","openshift-multus/multus-mnvt8","openshift-network-operator/iptables-alerter-v8rjh","kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x","openshift-dns/node-resolver-kls9s"]
Jul 08 01:42:21.048345 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.048318    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.050515 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.050492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.051002 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.050977    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 01:42:21.051112 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.051089    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vz4kd\""
Jul 08 01:42:21.051171 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.051151    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 01:42:21.052831 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.052736    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 01:42:21.052937 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.052922    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 01:42:21.053361 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.053343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:21.053441 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.053408    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:21.053506 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.053458    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qdd88\""
Jul 08 01:42:21.053658 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.053629    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 01:42:21.056393 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.056375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.058929 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.058881    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 01:42:21.059200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.059173    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 01:42:21.059626 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.059607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.059772 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.059702    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:21.060866 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.060585    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 01:42:21.060866 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.060600    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 01:42:21.060866 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.060651    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 01:42:21.060866 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.060745    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 01:42:21.061106 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.060871    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nxlwx\""
Jul 08 01:42:21.062220 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.062200    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:21.064952 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.064821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.064952 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.064871    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 01:42:21.065192 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.064995    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jqkt6\""
Jul 08 01:42:21.065260 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.065225    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 01:42:21.067361 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.067168    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 01:42:21.067361 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.067169    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.067508 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.067406    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 01:42:21.067770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.067642    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 01:42:21.067770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.067681    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 01:42:21.067770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.067748    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kt24m\""
Jul 08 01:42:21.068903 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.068875    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 01:42:21.069634 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.069616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:21.069748 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.069689    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:21.071393 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.071372    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 01:42:21.071485 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.071424    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tn5ph\""
Jul 08 01:42:21.072348 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.072326    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 01:42:21.073059 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.072699    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 01:42:21.073059 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.072959    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.077055 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.075860    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.077055 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.075997    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 01:42:21.077055 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.076114    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2vx2f\""
Jul 08 01:42:21.078529 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.078508    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.079617 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.079574    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 01:42:21.079718 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.079637    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 01:42:21.080113 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.080074    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 01:42:21.080214 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.080143    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-twchd\""
Jul 08 01:42:21.081523 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.081506    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 01:42:21.081612 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.081563    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-46m2x\""
Jul 08 01:42:21.081670 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.081651    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 01:42:21.093559 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.093517    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 01:37:20 +0000 UTC" deadline="2028-03-12 00:36:24.391240133 +0000 UTC"
Jul 08 01:42:21.093559 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.093558    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14710h54m3.297685088s"
Jul 08 01:42:21.146489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-tuned\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.146489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/929f0bf9-8da0-4292-8b05-02ada8f18ee2-tmp\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.146655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.146655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk6hm\" (UniqueName: \"kubernetes.io/projected/e345c217-7be1-423e-99a9-561a13393172-kube-api-access-jk6hm\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.146655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-systemd\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.146655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysconfig\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.146655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-run\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovnkube-config\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146676    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-kubernetes\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-systemd-units\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-run-netns\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-etc-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146831    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-slash\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.146857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-ovn\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146874    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2n8\" (UniqueName: \"kubernetes.io/projected/454d469d-dc88-4ed9-9ccb-0832350fbd22-kube-api-access-qj2n8\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-var-lib-kubelet\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-host\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-socket-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-sys-fs\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.146989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-modprobe-d\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysctl-d\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnthd\" (UniqueName: \"kubernetes.io/projected/929f0bf9-8da0-4292-8b05-02ada8f18ee2-kube-api-access-vnthd\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-device-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-cni-netd\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147173 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147170    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovnkube-script-lib\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147210    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-registration-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovn-node-metrics-cert\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-cni-bin\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-systemd\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-sys\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-lib-modules\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-kubelet\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-var-lib-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-node-log\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-log-socket\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-env-overrides\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.147666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.147484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysctl-conf\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.155147 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.155131    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 01:42:21.247855 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.247818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-systemd\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.247869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f901c57-a93e-431b-872c-4485deec3967-multus-daemon-config\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.248057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.247892    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-systemd\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.247910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1de4f947-6f40-44ee-9078-1770c1123dfc-host-slash\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.248057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.247951    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.248057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.247981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljlj\" (UniqueName: \"kubernetes.io/projected/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-kube-api-access-8ljlj\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:21.248057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-socket-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248096    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-kubernetes\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-systemd-units\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-run-netns\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248248    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-etc-selinux\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248256    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-socket-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-etc-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248304    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-kubernetes\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248309    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-etc-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248302    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248338    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-systemd-units\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248350    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.248376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-ovn\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248378    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-run-netns\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2n8\" (UniqueName: \"kubernetes.io/projected/454d469d-dc88-4ed9-9ccb-0832350fbd22-kube-api-access-qj2n8\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248421    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248439    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-ovn\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-host\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-netns\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a123056-ddd1-438a-99f5-015ea95bbdd4-serviceca\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248562    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-host\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnthd\" (UniqueName: \"kubernetes.io/projected/929f0bf9-8da0-4292-8b05-02ada8f18ee2-kube-api-access-vnthd\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-device-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e50e08d-503e-4439-8c9d-37077570c073-tmp-dir\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-cni-netd\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovnkube-script-lib\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248776    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-device-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:21.249111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgxcc\" (UniqueName: \"kubernetes.io/projected/bb986e71-ea1a-4767-8509-e039afcb753c-kube-api-access-kgxcc\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248843    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-cni-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-kubelet\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovn-node-metrics-cert\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248926    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-cni-netd\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-cni-bin\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248975    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-cni-bin\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.248977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-systemd\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-cnibin\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-cnibin\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249079    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-systemd\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-cni-multus\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-kubelet\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-env-overrides\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249241    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-kubelet\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysctl-conf\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249353    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/929f0bf9-8da0-4292-8b05-02ada8f18ee2-tmp\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.249891 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-system-cni-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f901c57-a93e-431b-872c-4485deec3967-cni-binary-copy\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-etc-kubernetes\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249503    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6hm\" (UniqueName: \"kubernetes.io/projected/e345c217-7be1-423e-99a9-561a13393172-kube-api-access-jk6hm\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249523    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysctl-conf\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249559    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovnkube-script-lib\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.249692    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-env-overrides\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.250450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysconfig\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.250480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-run\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.250506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-os-release\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.250543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-hostroot\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.250572    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysconfig\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.250588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1de4f947-6f40-44ee-9078-1770c1123dfc-iptables-alerter-script\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.250726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.250622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmg8d\" (UniqueName: \"kubernetes.io/projected/9e50e08d-503e-4439-8c9d-37077570c073-kube-api-access-gmg8d\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.251869 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.251836    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-run\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.251983 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.251940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7833b36c-c519-4737-8bf8-e63feee36e20-kubelet-config\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.252057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7833b36c-c519-4737-8bf8-e63feee36e20-dbus\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.252103 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-sys-fs\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.252144 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovnkube-config\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.252186 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252140    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tql6k\" (UniqueName: \"kubernetes.io/projected/2f901c57-a93e-431b-872c-4485deec3967-kube-api-access-tql6k\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.252186 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-slash\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.252272 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-var-lib-kubelet\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.252272 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252222    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-k8s-cni-cncf-io\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.252366 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-conf-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.252366 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252350    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-sys-fs\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.252458 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74144fe3-21d9-4741-b840-d6182f691d30-agent-certs\") pod \"konnectivity-agent-hbmmr\" (UID: \"74144fe3-21d9-4741-b840-d6182f691d30\") " pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:21.252458 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252416    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-slash\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.252458 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-modprobe-d\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.252598 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252465    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-var-lib-kubelet\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.252598 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysctl-d\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.252598 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252561    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-modprobe-d\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.252598 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252581    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-sysctl-d\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.252815 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-system-cni-dir\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.252815 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.252928 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxzt\" (UniqueName: \"kubernetes.io/projected/4a123056-ddd1-438a-99f5-015ea95bbdd4-kube-api-access-2cxzt\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.252928 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252854    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.252928 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.252915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-registration-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.253876 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.253600    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/929f0bf9-8da0-4292-8b05-02ada8f18ee2-tmp\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.253876 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.253752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovn-node-metrics-cert\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.253876 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.253771    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-run-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.253866    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e345c217-7be1-423e-99a9-561a13393172-registration-dir\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.253898    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/454d469d-dc88-4ed9-9ccb-0832350fbd22-ovnkube-config\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.253960    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-multus-certs\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7qk\" (UniqueName: \"kubernetes.io/projected/1de4f947-6f40-44ee-9078-1770c1123dfc-kube-api-access-jp7qk\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a123056-ddd1-438a-99f5-015ea95bbdd4-host\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-sys\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254093    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-lib-modules\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-cni-bin\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-var-lib-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254235    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-sys\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-node-log\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-log-socket\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254395    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-node-log\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254444    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-var-lib-openvswitch\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254448    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/929f0bf9-8da0-4292-8b05-02ada8f18ee2-lib-modules\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.256201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-tuned\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254524    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-log-socket\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-os-release\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-socket-dir-parent\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e50e08d-503e-4439-8c9d-37077570c073-hosts-file\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74144fe3-21d9-4741-b840-d6182f691d30-konnectivity-ca\") pod \"konnectivity-agent-hbmmr\" (UID: \"74144fe3-21d9-4741-b840-d6182f691d30\") " pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.254978    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/454d469d-dc88-4ed9-9ccb-0832350fbd22-host-run-ovn-kubernetes\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.255650    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.255672    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.255694    2582 projected.go:196] Error preparing data for projected volume kube-api-access-jlhhq for pod openshift-network-diagnostics/network-check-target-95trb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.255788    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq podName:8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:21.755762954 +0000 UTC m=+4.121596664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jlhhq" (UniqueName: "kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq") pod "network-check-target-95trb" (UID: "8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:21.257130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.256885    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/929f0bf9-8da0-4292-8b05-02ada8f18ee2-etc-tuned\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.258829 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.258806    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2n8\" (UniqueName: \"kubernetes.io/projected/454d469d-dc88-4ed9-9ccb-0832350fbd22-kube-api-access-qj2n8\") pod \"ovnkube-node-dm8hs\" (UID: \"454d469d-dc88-4ed9-9ccb-0832350fbd22\") " pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.259369 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.259345    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnthd\" (UniqueName: \"kubernetes.io/projected/929f0bf9-8da0-4292-8b05-02ada8f18ee2-kube-api-access-vnthd\") pod \"tuned-fj7x9\" (UID: \"929f0bf9-8da0-4292-8b05-02ada8f18ee2\") " pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.260512 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.260488    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk6hm\" (UniqueName: \"kubernetes.io/projected/e345c217-7be1-423e-99a9-561a13393172-kube-api-access-jk6hm\") pod \"aws-ebs-csi-driver-node-cvr2x\" (UID: \"e345c217-7be1-423e-99a9-561a13393172\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.355430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355357    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-system-cni-dir\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.355430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.355430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxzt\" (UniqueName: \"kubernetes.io/projected/4a123056-ddd1-438a-99f5-015ea95bbdd4-kube-api-access-2cxzt\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.355430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-multus-certs\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7qk\" (UniqueName: \"kubernetes.io/projected/1de4f947-6f40-44ee-9078-1770c1123dfc-kube-api-access-jp7qk\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a123056-ddd1-438a-99f5-015ea95bbdd4-host\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355481    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-system-cni-dir\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-cni-bin\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355521    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-cni-bin\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355521    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-multus-certs\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355574    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a123056-ddd1-438a-99f5-015ea95bbdd4-host\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-os-release\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-socket-dir-parent\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e50e08d-503e-4439-8c9d-37077570c073-hosts-file\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74144fe3-21d9-4741-b840-d6182f691d30-konnectivity-ca\") pod \"konnectivity-agent-hbmmr\" (UID: \"74144fe3-21d9-4741-b840-d6182f691d30\") " pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355726    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-socket-dir-parent\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355728    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-os-release\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.355740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f901c57-a93e-431b-872c-4485deec3967-multus-daemon-config\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1de4f947-6f40-44ee-9078-1770c1123dfc-host-slash\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355788    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e50e08d-503e-4439-8c9d-37077570c073-hosts-file\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.355821    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljlj\" (UniqueName: \"kubernetes.io/projected/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-kube-api-access-8ljlj\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.355910    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs podName:51350b5f-d0b4-4b03-93ba-92bcbe31deeb nodeName:}" failed. No retries permitted until 2026-07-08 01:42:21.855890783 +0000 UTC m=+4.221724503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs") pod "network-metrics-daemon-pv6z5" (UID: "51350b5f-d0b4-4b03-93ba-92bcbe31deeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-netns\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a123056-ddd1-438a-99f5-015ea95bbdd4-serviceca\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.355987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e50e08d-503e-4439-8c9d-37077570c073-tmp-dir\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356036    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgxcc\" (UniqueName: \"kubernetes.io/projected/bb986e71-ea1a-4767-8509-e039afcb753c-kube-api-access-kgxcc\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-cni-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356084    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1de4f947-6f40-44ee-9078-1770c1123dfc-host-slash\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-kubelet\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356113    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-cni-binary-copy\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.356461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-cnibin\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.356167    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-cnibin\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-cni-multus\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.356225    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret podName:7833b36c-c519-4737-8bf8-e63feee36e20 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:21.856210191 +0000 UTC m=+4.222043894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret") pod "global-pull-secret-syncer-cmvbh" (UID: "7833b36c-c519-4737-8bf8-e63feee36e20") : object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356248    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-cni-multus\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-system-cni-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f901c57-a93e-431b-872c-4485deec3967-cni-binary-copy\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356350    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-netns\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-etc-kubernetes\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356388    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f901c57-a93e-431b-872c-4485deec3967-multus-daemon-config\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356413    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-etc-kubernetes\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74144fe3-21d9-4741-b840-d6182f691d30-konnectivity-ca\") pod \"konnectivity-agent-hbmmr\" (UID: \"74144fe3-21d9-4741-b840-d6182f691d30\") " pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356419    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e50e08d-503e-4439-8c9d-37077570c073-tmp-dir\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-os-release\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-hostroot\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.357327 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356534    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-cnibin\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1de4f947-6f40-44ee-9078-1770c1123dfc-iptables-alerter-script\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356570    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-system-cni-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356575    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-cni-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmg8d\" (UniqueName: \"kubernetes.io/projected/9e50e08d-503e-4439-8c9d-37077570c073-kube-api-access-gmg8d\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356601    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-var-lib-kubelet\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7833b36c-c519-4737-8bf8-e63feee36e20-kubelet-config\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7833b36c-c519-4737-8bf8-e63feee36e20-dbus\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tql6k\" (UniqueName: \"kubernetes.io/projected/2f901c57-a93e-431b-872c-4485deec3967-kube-api-access-tql6k\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-k8s-cni-cncf-io\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-conf-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356747    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-cnibin\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74144fe3-21d9-4741-b840-d6182f691d30-agent-certs\") pod \"konnectivity-agent-hbmmr\" (UID: \"74144fe3-21d9-4741-b840-d6182f691d30\") " pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356816    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-hostroot\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356847    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a123056-ddd1-438a-99f5-015ea95bbdd4-serviceca\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356862    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bb986e71-ea1a-4767-8509-e039afcb753c-os-release\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356883    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7833b36c-c519-4737-8bf8-e63feee36e20-kubelet-config\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356923    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7833b36c-c519-4737-8bf8-e63feee36e20-dbus\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.358238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-host-run-k8s-cni-cncf-io\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.359111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.356965    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f901c57-a93e-431b-872c-4485deec3967-multus-conf-dir\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.359111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.357063    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1de4f947-6f40-44ee-9078-1770c1123dfc-iptables-alerter-script\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.359111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.357090    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f901c57-a93e-431b-872c-4485deec3967-cni-binary-copy\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.359111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.357363    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.359111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.357763    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bb986e71-ea1a-4767-8509-e039afcb753c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.359388 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.359345    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74144fe3-21d9-4741-b840-d6182f691d30-agent-certs\") pod \"konnectivity-agent-hbmmr\" (UID: \"74144fe3-21d9-4741-b840-d6182f691d30\") " pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:21.361225 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.361206    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fj7x9"
Jul 08 01:42:21.365881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.365852    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7qk\" (UniqueName: \"kubernetes.io/projected/1de4f947-6f40-44ee-9078-1770c1123dfc-kube-api-access-jp7qk\") pod \"iptables-alerter-v8rjh\" (UID: \"1de4f947-6f40-44ee-9078-1770c1123dfc\") " pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.366004 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.365889    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxzt\" (UniqueName: \"kubernetes.io/projected/4a123056-ddd1-438a-99f5-015ea95bbdd4-kube-api-access-2cxzt\") pod \"node-ca-2t5qg\" (UID: \"4a123056-ddd1-438a-99f5-015ea95bbdd4\") " pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.366135 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.366116    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmg8d\" (UniqueName: \"kubernetes.io/projected/9e50e08d-503e-4439-8c9d-37077570c073-kube-api-access-gmg8d\") pod \"node-resolver-kls9s\" (UID: \"9e50e08d-503e-4439-8c9d-37077570c073\") " pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.366523 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.366334    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljlj\" (UniqueName: \"kubernetes.io/projected/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-kube-api-access-8ljlj\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:21.367108 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.367082    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tql6k\" (UniqueName: \"kubernetes.io/projected/2f901c57-a93e-431b-872c-4485deec3967-kube-api-access-tql6k\") pod \"multus-mnvt8\" (UID: \"2f901c57-a93e-431b-872c-4485deec3967\") " pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.367243 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.367221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgxcc\" (UniqueName: \"kubernetes.io/projected/bb986e71-ea1a-4767-8509-e039afcb753c-kube-api-access-kgxcc\") pod \"multus-additional-cni-plugins-g5k5m\" (UID: \"bb986e71-ea1a-4767-8509-e039afcb753c\") " pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.369121 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.369104    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x"
Jul 08 01:42:21.381067 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.381048    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:21.388289 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.388269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:21.394034 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.394016    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g5k5m"
Jul 08 01:42:21.399978 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.399958    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2t5qg"
Jul 08 01:42:21.406745 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.406726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mnvt8"
Jul 08 01:42:21.413720 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.413690    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8rjh"
Jul 08 01:42:21.419522 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.419501    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kls9s"
Jul 08 01:42:21.759023 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.758931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:21.759171 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.759124    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 01:42:21.759171 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.759143    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 01:42:21.759171 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.759157    2582 projected.go:196] Error preparing data for projected volume kube-api-access-jlhhq for pod openshift-network-diagnostics/network-check-target-95trb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:21.759276 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.759232    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq podName:8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:22.759213351 +0000 UTC m=+5.125047055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jlhhq" (UniqueName: "kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq") pod "network-check-target-95trb" (UID: "8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:21.859749 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.859698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:21.859749 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:21.859756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:21.859994 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.859873    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:21.859994 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.859887    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:21.859994 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.859945    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret podName:7833b36c-c519-4737-8bf8-e63feee36e20 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:22.859927541 +0000 UTC m=+5.225761262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret") pod "global-pull-secret-syncer-cmvbh" (UID: "7833b36c-c519-4737-8bf8-e63feee36e20") : object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:21.859994 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:21.859960    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs podName:51350b5f-d0b4-4b03-93ba-92bcbe31deeb nodeName:}" failed. No retries permitted until 2026-07-08 01:42:22.859954047 +0000 UTC m=+5.225787747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs") pod "network-metrics-daemon-pv6z5" (UID: "51350b5f-d0b4-4b03-93ba-92bcbe31deeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:22.010170 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:22.010144    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb986e71_ea1a_4767_8509_e039afcb753c.slice/crio-b98b081de1117955c2c2a6cb37547825af770d3435e4a654a9fd011e625f9856 WatchSource:0}: Error finding container b98b081de1117955c2c2a6cb37547825af770d3435e4a654a9fd011e625f9856: Status 404 returned error can't find the container with id b98b081de1117955c2c2a6cb37547825af770d3435e4a654a9fd011e625f9856
Jul 08 01:42:22.012404 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:22.012376    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a123056_ddd1_438a_99f5_015ea95bbdd4.slice/crio-4e681f947722dee60cad9ee10184e00ad0a5985e5c7b5b8f026c130bc047b44b WatchSource:0}: Error finding container 4e681f947722dee60cad9ee10184e00ad0a5985e5c7b5b8f026c130bc047b44b: Status 404 returned error can't find the container with id 4e681f947722dee60cad9ee10184e00ad0a5985e5c7b5b8f026c130bc047b44b
Jul 08 01:42:22.015318 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:22.015289    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de4f947_6f40_44ee_9078_1770c1123dfc.slice/crio-3114139479a2aa94bf34711d2937a76619a70af5c37445bf54fc2634a22287a1 WatchSource:0}: Error finding container 3114139479a2aa94bf34711d2937a76619a70af5c37445bf54fc2634a22287a1: Status 404 returned error can't find the container with id 3114139479a2aa94bf34711d2937a76619a70af5c37445bf54fc2634a22287a1
Jul 08 01:42:22.016116 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:22.016050    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode345c217_7be1_423e_99a9_561a13393172.slice/crio-ef965e2e7f54a45f15e98cc176209cad1ee0030fd9d526823d9eb0f2d7ac5cd1 WatchSource:0}: Error finding container ef965e2e7f54a45f15e98cc176209cad1ee0030fd9d526823d9eb0f2d7ac5cd1: Status 404 returned error can't find the container with id ef965e2e7f54a45f15e98cc176209cad1ee0030fd9d526823d9eb0f2d7ac5cd1
Jul 08 01:42:22.021384 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:22.021111    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e50e08d_503e_4439_8c9d_37077570c073.slice/crio-b413acf65101b30cb1364f85382757c37918a19703fecaccb47d98a3a2f26db8 WatchSource:0}: Error finding container b413acf65101b30cb1364f85382757c37918a19703fecaccb47d98a3a2f26db8: Status 404 returned error can't find the container with id b413acf65101b30cb1364f85382757c37918a19703fecaccb47d98a3a2f26db8
Jul 08 01:42:22.022403 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:22.022364    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f901c57_a93e_431b_872c_4485deec3967.slice/crio-a759508de89e247f9716aa54162be7e1ea13a013cc0ad16a21d177b451fb68d2 WatchSource:0}: Error finding container a759508de89e247f9716aa54162be7e1ea13a013cc0ad16a21d177b451fb68d2: Status 404 returned error can't find the container with id a759508de89e247f9716aa54162be7e1ea13a013cc0ad16a21d177b451fb68d2
Jul 08 01:42:22.023150 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:22.023086    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454d469d_dc88_4ed9_9ccb_0832350fbd22.slice/crio-53a493d46af71df2edf964ef92bc40da8dee1d7f56d3f695d6157c75865ffec6 WatchSource:0}: Error finding container 53a493d46af71df2edf964ef92bc40da8dee1d7f56d3f695d6157c75865ffec6: Status 404 returned error can't find the container with id 53a493d46af71df2edf964ef92bc40da8dee1d7f56d3f695d6157c75865ffec6
Jul 08 01:42:22.094742 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.094530    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 01:37:20 +0000 UTC" deadline="2028-01-08 07:15:14.90780847 +0000 UTC"
Jul 08 01:42:22.094742 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.094741    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13181h32m52.813072236s"
Jul 08 01:42:22.165039 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.165011    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:22.165180 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.165116    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:22.165180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.165168    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:22.165271 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.165254    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:22.169766 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.169737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"53a493d46af71df2edf964ef92bc40da8dee1d7f56d3f695d6157c75865ffec6"}
Jul 08 01:42:22.172824 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.172800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbmmr" event={"ID":"74144fe3-21d9-4741-b840-d6182f691d30","Type":"ContainerStarted","Data":"d707de05dc8e91b72c64140657facdf957bd527fdbf8087bb612bd7292eae345"}
Jul 08 01:42:22.173949 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.173928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fj7x9" event={"ID":"929f0bf9-8da0-4292-8b05-02ada8f18ee2","Type":"ContainerStarted","Data":"717a5ea9cbe80da0dd1df7249a068ba4a25005610f9110bb745c19f15fad30d6"}
Jul 08 01:42:22.175686 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.175660    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" event={"ID":"4c6ce3691de19c622d88d1f963379cd4","Type":"ContainerStarted","Data":"cb41ca2502fde2c4ce6641622950909ec9f8cad582c9f3d6cd15cdc4a52b8694"}
Jul 08 01:42:22.180148 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.180123    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mnvt8" event={"ID":"2f901c57-a93e-431b-872c-4485deec3967","Type":"ContainerStarted","Data":"a759508de89e247f9716aa54162be7e1ea13a013cc0ad16a21d177b451fb68d2"}
Jul 08 01:42:22.182077 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.182055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kls9s" event={"ID":"9e50e08d-503e-4439-8c9d-37077570c073","Type":"ContainerStarted","Data":"b413acf65101b30cb1364f85382757c37918a19703fecaccb47d98a3a2f26db8"}
Jul 08 01:42:22.183672 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.183653    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x" event={"ID":"e345c217-7be1-423e-99a9-561a13393172","Type":"ContainerStarted","Data":"ef965e2e7f54a45f15e98cc176209cad1ee0030fd9d526823d9eb0f2d7ac5cd1"}
Jul 08 01:42:22.184721 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.184688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8rjh" event={"ID":"1de4f947-6f40-44ee-9078-1770c1123dfc","Type":"ContainerStarted","Data":"3114139479a2aa94bf34711d2937a76619a70af5c37445bf54fc2634a22287a1"}
Jul 08 01:42:22.186006 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.185922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2t5qg" event={"ID":"4a123056-ddd1-438a-99f5-015ea95bbdd4","Type":"ContainerStarted","Data":"4e681f947722dee60cad9ee10184e00ad0a5985e5c7b5b8f026c130bc047b44b"}
Jul 08 01:42:22.187089 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.187068    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" event={"ID":"bb986e71-ea1a-4767-8509-e039afcb753c","Type":"ContainerStarted","Data":"b98b081de1117955c2c2a6cb37547825af770d3435e4a654a9fd011e625f9856"}
Jul 08 01:42:22.196165 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.196105    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-104.ec2.internal" podStartSLOduration=2.1960896 podStartE2EDuration="2.1960896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:22.195145733 +0000 UTC m=+4.560979446" watchObservedRunningTime="2026-07-08 01:42:22.1960896 +0000 UTC m=+4.561923326"
Jul 08 01:42:22.766761 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.766059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:22.766761 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.766258    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 01:42:22.766761 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.766289    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 01:42:22.766761 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.766303    2582 projected.go:196] Error preparing data for projected volume kube-api-access-jlhhq for pod openshift-network-diagnostics/network-check-target-95trb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:22.766761 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.766365    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq podName:8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:24.766345801 +0000 UTC m=+7.132179506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jlhhq" (UniqueName: "kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq") pod "network-check-target-95trb" (UID: "8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:22.867012 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.866968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:22.867177 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:22.867076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:22.867234 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.867200    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:22.867282 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.867261    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs podName:51350b5f-d0b4-4b03-93ba-92bcbe31deeb nodeName:}" failed. No retries permitted until 2026-07-08 01:42:24.86724147 +0000 UTC m=+7.233075188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs") pod "network-metrics-daemon-pv6z5" (UID: "51350b5f-d0b4-4b03-93ba-92bcbe31deeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:22.867756 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.867736    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:22.867862 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:22.867790    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret podName:7833b36c-c519-4737-8bf8-e63feee36e20 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:24.867775588 +0000 UTC m=+7.233609304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret") pod "global-pull-secret-syncer-cmvbh" (UID: "7833b36c-c519-4737-8bf8-e63feee36e20") : object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:23.160016 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:23.159437    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:23.160016 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:23.159577    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:23.195719 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:23.195671    2582 generic.go:356] "Generic (PLEG): container finished" podID="dea9af4086c93b3b0be762c6dc0caca9" containerID="49e18d2a5d68fb59eaf9039c24b9e1666eaab8b5c9123f6e15c17d68ee257d2b" exitCode=0
Jul 08 01:42:23.196571 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:23.196541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" event={"ID":"dea9af4086c93b3b0be762c6dc0caca9","Type":"ContainerDied","Data":"49e18d2a5d68fb59eaf9039c24b9e1666eaab8b5c9123f6e15c17d68ee257d2b"}
Jul 08 01:42:24.165755 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:24.165722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:24.166240 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.165847    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:24.166240 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:24.166208    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:24.166349 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.166302    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:24.218257 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:24.218224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" event={"ID":"dea9af4086c93b3b0be762c6dc0caca9","Type":"ContainerStarted","Data":"c05797c41f25ff76665caa40e3eef7e370e254f03b9e3d2346f43515f0dee39d"}
Jul 08 01:42:24.785586 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:24.785548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:24.785792 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.785752    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 01:42:24.785792 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.785773    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 01:42:24.785792 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.785785    2582 projected.go:196] Error preparing data for projected volume kube-api-access-jlhhq for pod openshift-network-diagnostics/network-check-target-95trb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:24.785956 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.785844    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq podName:8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:28.785826098 +0000 UTC m=+11.151659800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jlhhq" (UniqueName: "kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq") pod "network-check-target-95trb" (UID: "8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:24.886678 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:24.886625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:24.886876 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:24.886685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:24.886876 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.886829    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:24.886981 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.886876    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:24.886981 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.886899    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs podName:51350b5f-d0b4-4b03-93ba-92bcbe31deeb nodeName:}" failed. No retries permitted until 2026-07-08 01:42:28.886880002 +0000 UTC m=+11.252713704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs") pod "network-metrics-daemon-pv6z5" (UID: "51350b5f-d0b4-4b03-93ba-92bcbe31deeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:24.886981 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:24.886932    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret podName:7833b36c-c519-4737-8bf8-e63feee36e20 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:28.886914613 +0000 UTC m=+11.252748317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret") pod "global-pull-secret-syncer-cmvbh" (UID: "7833b36c-c519-4737-8bf8-e63feee36e20") : object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:25.159606 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:25.159527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:25.159797 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:25.159663    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:26.160126 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:26.159635    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:26.160126 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:26.159783    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:26.160126 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:26.160119    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:26.160678 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:26.160231    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:27.159722 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:27.159674    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:27.159886 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:27.159825    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:28.161237 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:28.160607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:28.161237 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.160730    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:28.161237 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:28.161100    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:28.161237 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.161189    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:28.820968 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:28.820352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:28.820968 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.820538    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 01:42:28.820968 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.820559    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 01:42:28.820968 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.820572    2582 projected.go:196] Error preparing data for projected volume kube-api-access-jlhhq for pod openshift-network-diagnostics/network-check-target-95trb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:28.820968 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.820630    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq podName:8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:36.820611913 +0000 UTC m=+19.186445628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jlhhq" (UniqueName: "kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq") pod "network-check-target-95trb" (UID: "8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:28.920976 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:28.920935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:28.921139 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:28.920994    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:28.921220 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.921140    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:28.921220 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.921205    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret podName:7833b36c-c519-4737-8bf8-e63feee36e20 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:36.921187012 +0000 UTC m=+19.287020719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret") pod "global-pull-secret-syncer-cmvbh" (UID: "7833b36c-c519-4737-8bf8-e63feee36e20") : object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:28.921329 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.921142    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:28.921329 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:28.921303    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs podName:51350b5f-d0b4-4b03-93ba-92bcbe31deeb nodeName:}" failed. No retries permitted until 2026-07-08 01:42:36.921281261 +0000 UTC m=+19.287114965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs") pod "network-metrics-daemon-pv6z5" (UID: "51350b5f-d0b4-4b03-93ba-92bcbe31deeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:29.159593 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:29.159498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:29.159790 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:29.159649    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:30.159884 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:30.159805    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:30.159884 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:30.159792    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:30.160372 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:30.159956    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:30.160372 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:30.160323    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:31.159061 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:31.159024    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:31.159242 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:31.159185    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:32.159847 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:32.159816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:32.160315 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:32.159956    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:32.160315 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:32.160287    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:32.160436 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:32.160390    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:33.159496 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:33.159417    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:33.159640 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:33.159556    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:34.159758 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:34.159721    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:34.160193 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:34.159732    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:34.160193 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:34.159844    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:34.160193 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:34.159906    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:35.159336 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:35.159305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:35.159476 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:35.159439    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:36.160020 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:36.159987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:36.160557 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.160113    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:36.160557 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:36.160171    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:36.160557 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.160288    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:36.882898 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:36.882803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:36.883048 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.882931    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 01:42:36.883048 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.882955    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 01:42:36.883048 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.882967    2582 projected.go:196] Error preparing data for projected volume kube-api-access-jlhhq for pod openshift-network-diagnostics/network-check-target-95trb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:36.883048 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.883031    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq podName:8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:52.883013559 +0000 UTC m=+35.248847266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jlhhq" (UniqueName: "kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq") pod "network-check-target-95trb" (UID: "8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:36.984003 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:36.983970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:36.984175 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:36.984015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:36.984175 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.984124    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:36.984283 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.984125    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:36.984283 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.984180    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret podName:7833b36c-c519-4737-8bf8-e63feee36e20 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:52.984162571 +0000 UTC m=+35.349996289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret") pod "global-pull-secret-syncer-cmvbh" (UID: "7833b36c-c519-4737-8bf8-e63feee36e20") : object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:36.984386 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:36.984304    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs podName:51350b5f-d0b4-4b03-93ba-92bcbe31deeb nodeName:}" failed. No retries permitted until 2026-07-08 01:42:52.984288662 +0000 UTC m=+35.350122363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs") pod "network-metrics-daemon-pv6z5" (UID: "51350b5f-d0b4-4b03-93ba-92bcbe31deeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:37.159020 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:37.158944    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:37.159175 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:37.159072    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:38.159640 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:38.159609    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:38.160092 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:38.159728    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:38.160092 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:38.159792    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:38.160092 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:38.159892    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:39.159520 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:39.159484    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:39.159696 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:39.159603    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:40.159231 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:40.159199    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:40.159420 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:40.159309    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:40.159420 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:40.159373    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:40.159529 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:40.159472    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:41.159618 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.159404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:41.160326 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:41.159718    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:41.258988 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.258954    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mnvt8" event={"ID":"2f901c57-a93e-431b-872c-4485deec3967","Type":"ContainerStarted","Data":"a2163fa919b4a826c084404d850ffeee34839f737950829b7372fd960e1eeaab"}
Jul 08 01:42:41.260418 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.260393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kls9s" event={"ID":"9e50e08d-503e-4439-8c9d-37077570c073","Type":"ContainerStarted","Data":"3c0d654742c342588ecdd3ef6d655270648822ab02d002be813e21898c9079ca"}
Jul 08 01:42:41.261821 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.261800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x" event={"ID":"e345c217-7be1-423e-99a9-561a13393172","Type":"ContainerStarted","Data":"0cf1dfe7b85a47e631f907dcae1851ad0fb6bca43485ea383d6bd29cf4907be9"}
Jul 08 01:42:41.263240 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.263218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2t5qg" event={"ID":"4a123056-ddd1-438a-99f5-015ea95bbdd4","Type":"ContainerStarted","Data":"dc1835f9cedf1fa1c4329618661a885b879627613e9eda2cee9e3b5be68edc5c"}
Jul 08 01:42:41.264641 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.264621    2582 generic.go:356] "Generic (PLEG): container finished" podID="bb986e71-ea1a-4767-8509-e039afcb753c" containerID="172c324893391166b33ecef4042b03e97f59d5c4ddd54c37bbd99f23245b6115" exitCode=0
Jul 08 01:42:41.264750 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.264661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" event={"ID":"bb986e71-ea1a-4767-8509-e039afcb753c","Type":"ContainerDied","Data":"172c324893391166b33ecef4042b03e97f59d5c4ddd54c37bbd99f23245b6115"}
Jul 08 01:42:41.267303 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.267275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"314e1792f9d0b2b36f9a946f24b56ab11baf0f6fb76b52802f9ed46fccdc4256"}
Jul 08 01:42:41.267384 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.267344    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"6aa092a73be00e156392c7db514d24a38279b0a144cc430e72dc1de742aa9ac7"}
Jul 08 01:42:41.267501 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.267397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"0cdbd8a28447689aff506bfc2adc4238388b3d4f74c86c2d8d9c098364c93ffd"}
Jul 08 01:42:41.267501 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.267448    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"63fcb36ea3af4954902bf01cc982fe229e62164f69d8fcda90cc320789f5ea79"}
Jul 08 01:42:41.268762 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.268737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbmmr" event={"ID":"74144fe3-21d9-4741-b840-d6182f691d30","Type":"ContainerStarted","Data":"9735ea60eba9228cb6fbb8b31fe058c1420168748ac996500e7b837fa5ff3e19"}
Jul 08 01:42:41.270135 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.270108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fj7x9" event={"ID":"929f0bf9-8da0-4292-8b05-02ada8f18ee2","Type":"ContainerStarted","Data":"1bc23701cdf512d8bbc0fc00a864607117f267c4c161bc6cbb70987aeb42ecc1"}
Jul 08 01:42:41.275650 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.275611    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-104.ec2.internal" podStartSLOduration=21.275599409 podStartE2EDuration="21.275599409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:24.237271855 +0000 UTC m=+6.603105579" watchObservedRunningTime="2026-07-08 01:42:41.275599409 +0000 UTC m=+23.641433142"
Jul 08 01:42:41.275850 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.275817    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mnvt8" podStartSLOduration=4.456432749 podStartE2EDuration="23.27580969s" totalImagesPullingTime="18.819376941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:41.275156094 +0000 UTC m=+23.640989816" watchObservedRunningTime="2026-07-08 01:42:41.27580969 +0000 UTC m=+23.641643413"
Jul 08 01:42:41.288428 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.288392    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2t5qg" podStartSLOduration=4.506982689 podStartE2EDuration="23.288381183s" totalImagesPullingTime="18.781398494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:41.288201416 +0000 UTC m=+23.654035150" watchObservedRunningTime="2026-07-08 01:42:41.288381183 +0000 UTC m=+23.654214931"
Jul 08 01:42:41.320565 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.320531    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fj7x9" podStartSLOduration=4.546225849 podStartE2EDuration="23.320517181s" totalImagesPullingTime="18.774291332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:41.304456453 +0000 UTC m=+23.670290174" watchObservedRunningTime="2026-07-08 01:42:41.320517181 +0000 UTC m=+23.686350902"
Jul 08 01:42:41.351198 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.351159    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hbmmr" podStartSLOduration=12.619797169 podStartE2EDuration="23.351145833s" totalImagesPullingTime="10.731348664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:41.320644625 +0000 UTC m=+23.686478341" watchObservedRunningTime="2026-07-08 01:42:41.351145833 +0000 UTC m=+23.716979565"
Jul 08 01:42:41.367604 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.367568    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kls9s" podStartSLOduration=4.596278114 podStartE2EDuration="23.367553351s" totalImagesPullingTime="18.771275237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:41.367086035 +0000 UTC m=+23.732919757" watchObservedRunningTime="2026-07-08 01:42:41.367553351 +0000 UTC m=+23.733387072"
Jul 08 01:42:41.576214 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.576133    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:41.576691 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:41.576676    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:42.159543 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:42.159509    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:42.159889 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:42.159509    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:42.159889 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:42.159634    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:42.159889 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:42.159767    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:42.276588 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:42.276491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"dbc74a6573aeb6f38262bd04452e34e0d6bc8eb401cf9b23bc20ef634db55d8d"}
Jul 08 01:42:42.276588 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:42.276592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"2e34eed146a0ed6249975339876444985ea10445dab1a3004b85861f0af6b773"}
Jul 08 01:42:42.667066 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:42.667040    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 01:42:43.117065 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:43.116977    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T01:42:42.667060061Z","UUID":"5aaac70c-0fee-4d63-bcf5-0c7e20f8ed6f","Handler":null,"Name":"","Endpoint":""}
Jul 08 01:42:43.118351 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:43.118333    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 01:42:43.118463 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:43.118365    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 01:42:43.159681 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:43.159659    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:43.159828 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:43.159769    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:43.279446 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:43.279412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x" event={"ID":"e345c217-7be1-423e-99a9-561a13393172","Type":"ContainerStarted","Data":"98b26004909ba3ee800b621484af7d0fa439dadbb8f66a593fd641f83cb4495e"}
Jul 08 01:42:43.280915 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:43.280890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8rjh" event={"ID":"1de4f947-6f40-44ee-9078-1770c1123dfc","Type":"ContainerStarted","Data":"b0cb58e6864ef83ca99eadce70dec59cc5f6eaa3fb382482251a3bee72fd0624"}
Jul 08 01:42:43.281141 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:43.280923    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 01:42:44.159777 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:44.159523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:44.159933 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:44.159595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:44.159933 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:44.159884    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:44.160052 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:44.159963    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:44.285989 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:44.285960    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x" event={"ID":"e345c217-7be1-423e-99a9-561a13393172","Type":"ContainerStarted","Data":"b520018368f5d42fc135534707fb8bc34f3743c6cecbba9427c9e27d4069bea9"}
Jul 08 01:42:44.289844 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:44.289818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"ea660c59022b6dea1d7a9c750cd6a8982e0f0b2ad312d79413b35c8dc73197d5"}
Jul 08 01:42:44.306536 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:44.304994    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v8rjh" podStartSLOduration=7.526435521 podStartE2EDuration="26.304975803s" totalImagesPullingTime="18.778540282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:43.2961648 +0000 UTC m=+25.661998532" watchObservedRunningTime="2026-07-08 01:42:44.304975803 +0000 UTC m=+26.670809530"
Jul 08 01:42:44.306536 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:44.305153    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cvr2x" podStartSLOduration=4.56963761 podStartE2EDuration="26.305143888s" totalImagesPullingTime="21.735506278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:44.304049372 +0000 UTC m=+26.669883089" watchObservedRunningTime="2026-07-08 01:42:44.305143888 +0000 UTC m=+26.670977613"
Jul 08 01:42:45.159024 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:45.158993    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:45.159222 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:45.159120    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:45.565001 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:45.564925    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:45.565598 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:45.565059    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 08 01:42:45.565598 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:45.565534    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hbmmr"
Jul 08 01:42:46.159476 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:46.159439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:46.159655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:46.159485    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:46.159655 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:46.159566    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:46.159780 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:46.159701    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:47.159595 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:47.159369    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:47.160168 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:47.159633    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:47.298019 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:47.297980    2582 generic.go:356] "Generic (PLEG): container finished" podID="bb986e71-ea1a-4767-8509-e039afcb753c" containerID="507caae30a0a7f2748d0558fcb29fbd3be8fe1f1b942295ccbc0130c3f658d95" exitCode=0
Jul 08 01:42:47.298209 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:47.298063    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" event={"ID":"bb986e71-ea1a-4767-8509-e039afcb753c","Type":"ContainerDied","Data":"507caae30a0a7f2748d0558fcb29fbd3be8fe1f1b942295ccbc0130c3f658d95"}
Jul 08 01:42:47.301586 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:47.301567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" event={"ID":"454d469d-dc88-4ed9-9ccb-0832350fbd22","Type":"ContainerStarted","Data":"6928040063cbe2d43c0a8853091dae812e323c6ef6b3c23d5a69828a3090340e"}
Jul 08 01:42:47.301814 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:47.301800    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:47.301896 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:47.301848    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:47.316955 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:47.316936    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:47.343296 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:47.343253    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs" podStartSLOduration=10.505323733 podStartE2EDuration="29.343237872s" totalImagesPullingTime="18.837914139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:47.342600495 +0000 UTC m=+29.708434218" watchObservedRunningTime="2026-07-08 01:42:47.343237872 +0000 UTC m=+29.709071595"
Jul 08 01:42:48.160253 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.160224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:48.160746 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:48.160312    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:48.160746 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.160392    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:48.160746 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:48.160475    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:48.305201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.305162    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:48.322986 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.322896    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:42:48.427437 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.427405    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pv6z5"]
Jul 08 01:42:48.427565 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.427551    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:48.427685 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:48.427665    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:48.430587 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.430550    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cmvbh"]
Jul 08 01:42:48.430748 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.430654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:48.430815 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:48.430783    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:48.431276 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.431242    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-95trb"]
Jul 08 01:42:48.431587 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:48.431337    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:48.431587 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:48.431426    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:49.308641 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:49.308459    2582 generic.go:356] "Generic (PLEG): container finished" podID="bb986e71-ea1a-4767-8509-e039afcb753c" containerID="2c9caadcd78e5bdec8dd3b051448db7f85b5ef342b85167fa3deee955205041e" exitCode=0
Jul 08 01:42:49.308641 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:49.308543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" event={"ID":"bb986e71-ea1a-4767-8509-e039afcb753c","Type":"ContainerDied","Data":"2c9caadcd78e5bdec8dd3b051448db7f85b5ef342b85167fa3deee955205041e"}
Jul 08 01:42:50.159074 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:50.159040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:50.159234 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:50.159040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:50.159234 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:50.159163    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:50.159234 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:50.159200    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:50.159234 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:50.159057    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:50.159362 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:50.159310    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:51.314826 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:51.314795    2582 generic.go:356] "Generic (PLEG): container finished" podID="bb986e71-ea1a-4767-8509-e039afcb753c" containerID="bded88900535e554dbdf92bebcc8c10188ea12284cbe8b3f8bf0d48b07ed4371" exitCode=0
Jul 08 01:42:51.315342 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:51.314848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" event={"ID":"bb986e71-ea1a-4767-8509-e039afcb753c","Type":"ContainerDied","Data":"bded88900535e554dbdf92bebcc8c10188ea12284cbe8b3f8bf0d48b07ed4371"}
Jul 08 01:42:52.159738 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:52.159633    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:52.159738 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:52.159660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:52.159738 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:52.159663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:52.160007 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:52.159784    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:52.160007 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:52.159902    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:52.160087 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:52.160013    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:52.908604 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:52.908521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:52.908993 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:52.908667    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 01:42:52.908993 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:52.908690    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 01:42:52.908993 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:52.908699    2582 projected.go:196] Error preparing data for projected volume kube-api-access-jlhhq for pod openshift-network-diagnostics/network-check-target-95trb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:52.908993 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:52.908768    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq podName:8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:24.908749889 +0000 UTC m=+67.274583591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jlhhq" (UniqueName: "kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq") pod "network-check-target-95trb" (UID: "8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 01:42:53.009283 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:53.009248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:53.009283 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:53.009286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:53.009525 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:53.009385    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:53.009525 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:53.009401    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:53.009525 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:53.009441    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret podName:7833b36c-c519-4737-8bf8-e63feee36e20 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:25.009423915 +0000 UTC m=+67.375257616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret") pod "global-pull-secret-syncer-cmvbh" (UID: "7833b36c-c519-4737-8bf8-e63feee36e20") : object "kube-system"/"original-pull-secret" not registered
Jul 08 01:42:53.009525 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:53.009460    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs podName:51350b5f-d0b4-4b03-93ba-92bcbe31deeb nodeName:}" failed. No retries permitted until 2026-07-08 01:43:25.009451476 +0000 UTC m=+67.375285176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs") pod "network-metrics-daemon-pv6z5" (UID: "51350b5f-d0b4-4b03-93ba-92bcbe31deeb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 01:42:54.159649 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.159615    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:54.160115 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.159615    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:54.160115 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:54.159765    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cmvbh" podUID="7833b36c-c519-4737-8bf8-e63feee36e20"
Jul 08 01:42:54.160115 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:54.159827    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-95trb" podUID="8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2"
Jul 08 01:42:54.160115 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.159623    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:54.160115 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:54.159933    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pv6z5" podUID="51350b5f-d0b4-4b03-93ba-92bcbe31deeb"
Jul 08 01:42:54.831614 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.831575    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-104.ec2.internal" event="NodeReady"
Jul 08 01:42:54.831805 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.831762    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 01:42:54.867123 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.867090    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d75f7867c-2qj2v"]
Jul 08 01:42:54.891400 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.891370    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmnhz"]
Jul 08 01:42:54.891608 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.891513    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:54.894544 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.894516    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 01:42:54.895330 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.895300    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 01:42:54.895445 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.895415    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 01:42:54.895563 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.895543    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-65qmt\""
Jul 08 01:42:54.904330 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.903976    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 01:42:54.905742 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.905700    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d75f7867c-2qj2v"]
Jul 08 01:42:54.905833 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.905757    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x9wr5"]
Jul 08 01:42:54.905912 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.905889    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:54.908556 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.908533    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 01:42:54.908556 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.908541    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 01:42:54.908754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.908600    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v5bn9\""
Jul 08 01:42:54.927401 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.927377    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmnhz"]
Jul 08 01:42:54.927490 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.927417    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x9wr5"]
Jul 08 01:42:54.927536 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.927490    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x9wr5"
Jul 08 01:42:54.930066 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.930045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-psvfg\""
Jul 08 01:42:54.930168 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.930118    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 01:42:54.930168 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.930046    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 01:42:54.930280 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:54.930196    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.025257 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025222    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-trusted-ca\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.025257 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.025501 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzvwl\" (UniqueName: \"kubernetes.io/projected/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-kube-api-access-mzvwl\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.025501 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/692a83fa-c903-4b0e-90c5-55c01a4847b0-ca-trust-extracted\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.025501 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbd26fd0-e8ea-420f-9495-9a4de39d8213-cert\") pod \"ingress-canary-x9wr5\" (UID: \"cbd26fd0-e8ea-420f-9495-9a4de39d8213\") " pod="openshift-ingress-canary/ingress-canary-x9wr5"
Jul 08 01:42:55.025653 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp4rl\" (UniqueName: \"kubernetes.io/projected/cbd26fd0-e8ea-420f-9495-9a4de39d8213-kube-api-access-kp4rl\") pod \"ingress-canary-x9wr5\" (UID: \"cbd26fd0-e8ea-420f-9495-9a4de39d8213\") " pod="openshift-ingress-canary/ingress-canary-x9wr5"
Jul 08 01:42:55.025653 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-image-registry-private-configuration\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.025653 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j9r2\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-kube-api-access-7j9r2\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.025653 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-config-volume\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.025843 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-certificates\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.025843 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-installation-pull-secrets\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.025843 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025796    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-bound-sa-token\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.025843 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-tmp-dir\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.026012 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.025866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127142 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-config-volume\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.127142 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-certificates\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-installation-pull-secrets\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-bound-sa-token\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-tmp-dir\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.127356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127266    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-trusted-ca\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.127356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzvwl\" (UniqueName: \"kubernetes.io/projected/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-kube-api-access-mzvwl\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.127356 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/692a83fa-c903-4b0e-90c5-55c01a4847b0-ca-trust-extracted\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127684 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbd26fd0-e8ea-420f-9495-9a4de39d8213-cert\") pod \"ingress-canary-x9wr5\" (UID: \"cbd26fd0-e8ea-420f-9495-9a4de39d8213\") " pod="openshift-ingress-canary/ingress-canary-x9wr5"
Jul 08 01:42:55.127684 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp4rl\" (UniqueName: \"kubernetes.io/projected/cbd26fd0-e8ea-420f-9495-9a4de39d8213-kube-api-access-kp4rl\") pod \"ingress-canary-x9wr5\" (UID: \"cbd26fd0-e8ea-420f-9495-9a4de39d8213\") " pod="openshift-ingress-canary/ingress-canary-x9wr5"
Jul 08 01:42:55.127684 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-image-registry-private-configuration\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127684 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j9r2\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-kube-api-access-7j9r2\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.127684 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127583    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-config-volume\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.127684 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.127645    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 01:42:55.127966 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.127699    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls podName:5470ee1b-e719-4a61-b2aa-b5efb6f8942d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:55.627683058 +0000 UTC m=+37.993516772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls") pod "dns-default-hmnhz" (UID: "5470ee1b-e719-4a61-b2aa-b5efb6f8942d") : secret "dns-default-metrics-tls" not found
Jul 08 01:42:55.127966 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.127842    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-tmp-dir\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.128274 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.128153    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 01:42:55.128274 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.128173    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d75f7867c-2qj2v: secret "image-registry-tls" not found
Jul 08 01:42:55.128274 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.128207    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-certificates\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.128274 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.128230    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-trusted-ca\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.128274 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.128247    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls podName:692a83fa-c903-4b0e-90c5-55c01a4847b0 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:55.6282282 +0000 UTC m=+37.994061915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls") pod "image-registry-5d75f7867c-2qj2v" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0") : secret "image-registry-tls" not found
Jul 08 01:42:55.128563 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.128324    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/692a83fa-c903-4b0e-90c5-55c01a4847b0-ca-trust-extracted\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.132134 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.132089    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-installation-pull-secrets\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.132134 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.132120    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-image-registry-private-configuration\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.132409 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.132389    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbd26fd0-e8ea-420f-9495-9a4de39d8213-cert\") pod \"ingress-canary-x9wr5\" (UID: \"cbd26fd0-e8ea-420f-9495-9a4de39d8213\") " pod="openshift-ingress-canary/ingress-canary-x9wr5"
Jul 08 01:42:55.138763 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.138720    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzvwl\" (UniqueName: \"kubernetes.io/projected/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-kube-api-access-mzvwl\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.138867 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.138838    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-bound-sa-token\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.139108 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.139078    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j9r2\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-kube-api-access-7j9r2\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.139414 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.139393    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp4rl\" (UniqueName: \"kubernetes.io/projected/cbd26fd0-e8ea-420f-9495-9a4de39d8213-kube-api-access-kp4rl\") pod \"ingress-canary-x9wr5\" (UID: \"cbd26fd0-e8ea-420f-9495-9a4de39d8213\") " pod="openshift-ingress-canary/ingress-canary-x9wr5"
Jul 08 01:42:55.235726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.235673    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x9wr5"
Jul 08 01:42:55.473939 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.473842    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"]
Jul 08 01:42:55.495884 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.495842    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"]
Jul 08 01:42:55.496062 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.495962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:55.498856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.498823    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.499012 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.498947    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-km7d6\""
Jul 08 01:42:55.499116 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.499099    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 08 01:42:55.499609 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.499589    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.511859 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.511834    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-kjx2n"]
Jul 08 01:42:55.511968 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.511952    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.514819 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.514793    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.514933 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.514873    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 08 01:42:55.514933 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.514919    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rbzwv\""
Jul 08 01:42:55.515034 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.514993    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.515034 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.515018    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 08 01:42:55.525935 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.525918    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"]
Jul 08 01:42:55.526020 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.525949    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"]
Jul 08 01:42:55.526084 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.526023    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.526084 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.526043    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-kjx2n"]
Jul 08 01:42:55.528803 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.528777    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.528803 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.528797    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.529060 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.528874    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 08 01:42:55.529060 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.528902    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8zjqv\""
Jul 08 01:42:55.529060 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.528929    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 08 01:42:55.536540 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.536071    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 08 01:42:55.573999 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.573969    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w"]
Jul 08 01:42:55.589967 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.589944    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"]
Jul 08 01:42:55.590092 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.590077    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w"
Jul 08 01:42:55.592977 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.592955    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.593223 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.593200    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xbmlx\""
Jul 08 01:42:55.593325 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.593281    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.604054 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.604035    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-j2cdv"]
Jul 08 01:42:55.604204 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.604148    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.607122 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.607104    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.607221 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.607122    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.607436 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.607420    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 08 01:42:55.608792 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.608775    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 08 01:42:55.618611 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.618593    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jmsk6\""
Jul 08 01:42:55.622359 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.622342    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d948f6b97-b56nd"]
Jul 08 01:42:55.622453 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.622437    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.625088 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.625069    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 08 01:42:55.625200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.625183    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c2rbl\""
Jul 08 01:42:55.625200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.625192    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.625310 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.625077    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 08 01:42:55.625367 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.625348    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.631177 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631157    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 08 01:42:55.631534 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:55.631622 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmtrz\" (UniqueName: \"kubernetes.io/projected/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-kube-api-access-zmtrz\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.631685 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-config\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.631685 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:55.631810 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvmd\" (UniqueName: \"kubernetes.io/projected/ce16e9fd-3879-47e0-bcff-044b6dfa3180-kube-api-access-4fvmd\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:55.631810 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:55.631810 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/949f7197-dd85-4a7e-9e26-632696936f4c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.632014 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.631807    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 01:42:55.632014 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.631824    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d75f7867c-2qj2v: secret "image-registry-tls" not found
Jul 08 01:42:55.632014 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.631840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-serving-cert\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.632014 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.631879    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 01:42:55.632014 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.631935    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls podName:5470ee1b-e719-4a61-b2aa-b5efb6f8942d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:56.631918865 +0000 UTC m=+38.997752566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls") pod "dns-default-hmnhz" (UID: "5470ee1b-e719-4a61-b2aa-b5efb6f8942d") : secret "dns-default-metrics-tls" not found
Jul 08 01:42:55.632243 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.632026    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls podName:692a83fa-c903-4b0e-90c5-55c01a4847b0 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:56.631971967 +0000 UTC m=+38.997805668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls") pod "image-registry-5d75f7867c-2qj2v" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0") : secret "image-registry-tls" not found
Jul 08 01:42:55.632243 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.632093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/949f7197-dd85-4a7e-9e26-632696936f4c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.632243 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.632113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-trusted-ca\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.632243 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.632143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg9k7\" (UniqueName: \"kubernetes.io/projected/949f7197-dd85-4a7e-9e26-632696936f4c-kube-api-access-bg9k7\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.642580 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.642562    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w"]
Jul 08 01:42:55.642721 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.642591    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"]
Jul 08 01:42:55.642721 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.642609    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-j2cdv"]
Jul 08 01:42:55.642721 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.642694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.642721 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.642719    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf"]
Jul 08 01:42:55.645255 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.645237    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 08 01:42:55.645722 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.645527    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 08 01:42:55.645722 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.645538    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.645722 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.645554    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.645722 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.645606    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 08 01:42:55.646076 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.646056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 08 01:42:55.646156 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.646103    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mkwld\""
Jul 08 01:42:55.666466 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.666446    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d948f6b97-b56nd"]
Jul 08 01:42:55.666565 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.666476    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf"]
Jul 08 01:42:55.666620 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.666581    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf"
Jul 08 01:42:55.669343 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.669321    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.670983 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.669534    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hvq9k\""
Jul 08 01:42:55.670983 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.669535    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.676436 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.676416    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"]
Jul 08 01:42:55.694690 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.694620    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"]
Jul 08 01:42:55.694836 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.694759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.697531 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.697505    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 08 01:42:55.697680 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.697656    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 08 01:42:55.697680 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.697660    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 08 01:42:55.697856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.697695    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 08 01:42:55.697856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.697812    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mc77x\""
Jul 08 01:42:55.733352 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-serving-cert\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.733352 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733316    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-serving-cert\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.733352 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw9k4\" (UniqueName: \"kubernetes.io/projected/f2138832-8c0b-47ac-a7ea-2ac8ee294447-kube-api-access-qw9k4\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.733605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb9ca78d-379e-41fb-baed-0446060babb9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.733605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-config\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.733605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvmd\" (UniqueName: \"kubernetes.io/projected/ce16e9fd-3879-47e0-bcff-044b6dfa3180-kube-api-access-4fvmd\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:55.733605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-default-certificate\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.733605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/949f7197-dd85-4a7e-9e26-632696936f4c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.733605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfjdv\" (UniqueName: \"kubernetes.io/projected/bb9ca78d-379e-41fb-baed-0446060babb9-kube-api-access-pfjdv\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-snapshots\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92v8k\" (UniqueName: \"kubernetes.io/projected/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-kube-api-access-92v8k\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-stats-auth\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-tmp\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-trusted-ca\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/949f7197-dd85-4a7e-9e26-632696936f4c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.733922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg9k7\" (UniqueName: \"kubernetes.io/projected/949f7197-dd85-4a7e-9e26-632696936f4c-kube-api-access-bg9k7\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.733995    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.734021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.734081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsrnm\" (UniqueName: \"kubernetes.io/projected/7ca7ad82-aab4-48dd-b885-f3e673aec8f1-kube-api-access-gsrnm\") pod \"volume-data-source-validator-5d456fdbcd-nsn2w\" (UID: \"7ca7ad82-aab4-48dd-b885-f3e673aec8f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w"
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.734114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmtrz\" (UniqueName: \"kubernetes.io/projected/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-kube-api-access-zmtrz\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.734181    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/949f7197-dd85-4a7e-9e26-632696936f4c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.734197    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-config\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.734288    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 01:42:55.734367 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.734357    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls podName:ce16e9fd-3879-47e0-bcff-044b6dfa3180 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:56.234331088 +0000 UTC m=+38.600164789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gbljk" (UID: "ce16e9fd-3879-47e0-bcff-044b6dfa3180") : secret "samples-operator-tls" not found
Jul 08 01:42:55.734869 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.734782    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-trusted-ca\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.736549 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.736525    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-serving-cert\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.736652 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.736524    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/949f7197-dd85-4a7e-9e26-632696936f4c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.741687 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.741661    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvmd\" (UniqueName: \"kubernetes.io/projected/ce16e9fd-3879-47e0-bcff-044b6dfa3180-kube-api-access-4fvmd\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:55.743222 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.743178    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg9k7\" (UniqueName: \"kubernetes.io/projected/949f7197-dd85-4a7e-9e26-632696936f4c-kube-api-access-bg9k7\") pod \"kube-storage-version-migrator-operator-846bf668f7-dq485\" (UID: \"949f7197-dd85-4a7e-9e26-632696936f4c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.743781 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.743762    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmtrz\" (UniqueName: \"kubernetes.io/projected/8a09e13c-2839-42f4-9bda-5dbd0c89c9c9-kube-api-access-zmtrz\") pod \"console-operator-68b757fb67-kjx2n\" (UID: \"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9\") " pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.772555 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.772520    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:42:55.821777 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.821744    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"
Jul 08 01:42:55.834461 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6436ac3-aade-42e2-9740-cc73adb66b91-config\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.834571 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6436ac3-aade-42e2-9740-cc73adb66b91-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.834571 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nq7g\" (UniqueName: \"kubernetes.io/projected/e6436ac3-aade-42e2-9740-cc73adb66b91-kube-api-access-7nq7g\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.834571 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-serving-cert\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.834571 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw9k4\" (UniqueName: \"kubernetes.io/projected/f2138832-8c0b-47ac-a7ea-2ac8ee294447-kube-api-access-qw9k4\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.834783 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb9ca78d-379e-41fb-baed-0446060babb9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.834783 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-default-certificate\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.834783 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfjdv\" (UniqueName: \"kubernetes.io/projected/bb9ca78d-379e-41fb-baed-0446060babb9-kube-api-access-pfjdv\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.834916 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-snapshots\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.834916 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92v8k\" (UniqueName: \"kubernetes.io/projected/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-kube-api-access-92v8k\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.834916 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-stats-auth\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.834916 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-tmp\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.834916 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.834894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.835138 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.835138 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.835138 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.835138 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.835331 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhw4t\" (UniqueName: \"kubernetes.io/projected/a547e197-12f8-4b9f-8a29-4943f7c740f7-kube-api-access-zhw4t\") pod \"network-check-source-989f8b8dc-lscpf\" (UID: \"a547e197-12f8-4b9f-8a29-4943f7c740f7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf"
Jul 08 01:42:55.835331 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsrnm\" (UniqueName: \"kubernetes.io/projected/7ca7ad82-aab4-48dd-b885-f3e673aec8f1-kube-api-access-gsrnm\") pod \"volume-data-source-validator-5d456fdbcd-nsn2w\" (UID: \"7ca7ad82-aab4-48dd-b885-f3e673aec8f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w"
Jul 08 01:42:55.835476 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.835430    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 01:42:55.835528 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835430    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb9ca78d-379e-41fb-baed-0446060babb9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.835528 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.835515    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls podName:bb9ca78d-379e-41fb-baed-0446060babb9 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:56.335496287 +0000 UTC m=+38.701329998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c7skd" (UID: "bb9ca78d-379e-41fb-baed-0446060babb9") : secret "cluster-monitoring-operator-tls" not found
Jul 08 01:42:55.835632 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.835543    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:56.335526414 +0000 UTC m=+38.701360130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : configmap references non-existent config key: service-ca.crt
Jul 08 01:42:55.835632 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.835546    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 01:42:55.835632 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835583    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-snapshots\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.835632 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:55.835592    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:56.335580985 +0000 UTC m=+38.701414691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : secret "router-metrics-certs-default" not found
Jul 08 01:42:55.835855 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835738    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.835911 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.835870    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-tmp\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.836233 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.836040    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.836233 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.836054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:42:55.837739 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.837695    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-serving-cert\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.837889 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.837866    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-stats-auth\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.838000 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.837905    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-default-certificate\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.846644 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.846609    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfjdv\" (UniqueName: \"kubernetes.io/projected/bb9ca78d-379e-41fb-baed-0446060babb9-kube-api-access-pfjdv\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:55.847910 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.847887    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw9k4\" (UniqueName: \"kubernetes.io/projected/f2138832-8c0b-47ac-a7ea-2ac8ee294447-kube-api-access-qw9k4\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:55.848272 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.848234    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsrnm\" (UniqueName: \"kubernetes.io/projected/7ca7ad82-aab4-48dd-b885-f3e673aec8f1-kube-api-access-gsrnm\") pod \"volume-data-source-validator-5d456fdbcd-nsn2w\" (UID: \"7ca7ad82-aab4-48dd-b885-f3e673aec8f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w"
Jul 08 01:42:55.848599 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.848580    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92v8k\" (UniqueName: \"kubernetes.io/projected/a01783bc-0824-4f3c-a7cf-ccc633c5a55b-kube-api-access-92v8k\") pod \"insights-operator-5c847dcfc4-j2cdv\" (UID: \"a01783bc-0824-4f3c-a7cf-ccc633c5a55b\") " pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.871496 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.871463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:42:55.902377 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.902346    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w"
Jul 08 01:42:55.932837 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.932809    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv"
Jul 08 01:42:55.936200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.936178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhw4t\" (UniqueName: \"kubernetes.io/projected/a547e197-12f8-4b9f-8a29-4943f7c740f7-kube-api-access-zhw4t\") pod \"network-check-source-989f8b8dc-lscpf\" (UID: \"a547e197-12f8-4b9f-8a29-4943f7c740f7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf"
Jul 08 01:42:55.936311 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.936240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6436ac3-aade-42e2-9740-cc73adb66b91-config\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.936311 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.936266    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6436ac3-aade-42e2-9740-cc73adb66b91-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.936311 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.936290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nq7g\" (UniqueName: \"kubernetes.io/projected/e6436ac3-aade-42e2-9740-cc73adb66b91-kube-api-access-7nq7g\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.936969 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.936942    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6436ac3-aade-42e2-9740-cc73adb66b91-config\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.938661 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.938638    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6436ac3-aade-42e2-9740-cc73adb66b91-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.943933 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.943911    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nq7g\" (UniqueName: \"kubernetes.io/projected/e6436ac3-aade-42e2-9740-cc73adb66b91-kube-api-access-7nq7g\") pod \"service-ca-operator-5d46d9ffd4-85w77\" (UID: \"e6436ac3-aade-42e2-9740-cc73adb66b91\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:55.944389 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.944372    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhw4t\" (UniqueName: \"kubernetes.io/projected/a547e197-12f8-4b9f-8a29-4943f7c740f7-kube-api-access-zhw4t\") pod \"network-check-source-989f8b8dc-lscpf\" (UID: \"a547e197-12f8-4b9f-8a29-4943f7c740f7\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf"
Jul 08 01:42:55.977314 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:55.977290    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf"
Jul 08 01:42:56.005385 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.005363    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"
Jul 08 01:42:56.164057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.163893    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:42:56.164200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.163916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:42:56.164254 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.163964    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:42:56.168033 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.167177    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkcps\""
Jul 08 01:42:56.168033 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.167434    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 01:42:56.168033 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.167552    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 01:42:56.168033 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.167641    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2x5xt\""
Jul 08 01:42:56.238574 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.238527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:56.239096 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.238734    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 01:42:56.239096 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.238807    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls podName:ce16e9fd-3879-47e0-bcff-044b6dfa3180 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:57.238784613 +0000 UTC m=+39.604618329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gbljk" (UID: "ce16e9fd-3879-47e0-bcff-044b6dfa3180") : secret "samples-operator-tls" not found
Jul 08 01:42:56.340574 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.340536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:56.341200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.340598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:56.341200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.340643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:56.341200 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.340866    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:57.340846116 +0000 UTC m=+39.706679888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : configmap references non-existent config key: service-ca.crt
Jul 08 01:42:56.342613 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.342184    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 01:42:56.342613 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.342252    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:57.342234309 +0000 UTC m=+39.708068009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : secret "router-metrics-certs-default" not found
Jul 08 01:42:56.342613 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.342318    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 01:42:56.342613 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.342350    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls podName:bb9ca78d-379e-41fb-baed-0446060babb9 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:57.342339525 +0000 UTC m=+39.708173230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c7skd" (UID: "bb9ca78d-379e-41fb-baed-0446060babb9") : secret "cluster-monitoring-operator-tls" not found
Jul 08 01:42:56.445419 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.445386    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485"]
Jul 08 01:42:56.456348 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.456289    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w"]
Jul 08 01:42:56.459615 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:56.459590    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca7ad82_aab4_48dd_b885_f3e673aec8f1.slice/crio-335d67d4cf9085590db7e5cfa2e89ba9ce76cf51cd07c85f8c6e654b2e97419d WatchSource:0}: Error finding container 335d67d4cf9085590db7e5cfa2e89ba9ce76cf51cd07c85f8c6e654b2e97419d: Status 404 returned error can't find the container with id 335d67d4cf9085590db7e5cfa2e89ba9ce76cf51cd07c85f8c6e654b2e97419d
Jul 08 01:42:56.463209 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.463180    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-kjx2n"]
Jul 08 01:42:56.466156 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.466092    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x9wr5"]
Jul 08 01:42:56.466402 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:56.466292    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a09e13c_2839_42f4_9bda_5dbd0c89c9c9.slice/crio-e2ef7b0876b96413bd2e2aa84f0139822f3584114ffa97f53dd88e9edea43ae7 WatchSource:0}: Error finding container e2ef7b0876b96413bd2e2aa84f0139822f3584114ffa97f53dd88e9edea43ae7: Status 404 returned error can't find the container with id e2ef7b0876b96413bd2e2aa84f0139822f3584114ffa97f53dd88e9edea43ae7
Jul 08 01:42:56.469054 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.468977    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf"]
Jul 08 01:42:56.469741 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:56.469719    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd26fd0_e8ea_420f_9495_9a4de39d8213.slice/crio-8790d49eefbf618eb925a92ec0d84d368f1fcaab1f971f6685c6792d4c1c4461 WatchSource:0}: Error finding container 8790d49eefbf618eb925a92ec0d84d368f1fcaab1f971f6685c6792d4c1c4461: Status 404 returned error can't find the container with id 8790d49eefbf618eb925a92ec0d84d368f1fcaab1f971f6685c6792d4c1c4461
Jul 08 01:42:56.472058 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:56.472039    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda547e197_12f8_4b9f_8a29_4943f7c740f7.slice/crio-4c1d235c54f731350a9e2e0b8b2506529550d9ee478315eb25169cc378ff82bf WatchSource:0}: Error finding container 4c1d235c54f731350a9e2e0b8b2506529550d9ee478315eb25169cc378ff82bf: Status 404 returned error can't find the container with id 4c1d235c54f731350a9e2e0b8b2506529550d9ee478315eb25169cc378ff82bf
Jul 08 01:42:56.479030 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.477545    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77"]
Jul 08 01:42:56.482472 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:56.482446    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6436ac3_aade_42e2_9740_cc73adb66b91.slice/crio-185f66dc1c22c2177af9e553ec52876ddad01aa046521e9ae2be851734cd7256 WatchSource:0}: Error finding container 185f66dc1c22c2177af9e553ec52876ddad01aa046521e9ae2be851734cd7256: Status 404 returned error can't find the container with id 185f66dc1c22c2177af9e553ec52876ddad01aa046521e9ae2be851734cd7256
Jul 08 01:42:56.488560 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.488534    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-j2cdv"]
Jul 08 01:42:56.493201 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:42:56.493176    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01783bc_0824_4f3c_a7cf_ccc633c5a55b.slice/crio-49a08ca4b6090bf3db2137db971f0feb22eec877866a9ac77524a2ce0181c421 WatchSource:0}: Error finding container 49a08ca4b6090bf3db2137db971f0feb22eec877866a9ac77524a2ce0181c421: Status 404 returned error can't find the container with id 49a08ca4b6090bf3db2137db971f0feb22eec877866a9ac77524a2ce0181c421
Jul 08 01:42:56.643811 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.643782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:56.643980 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.643961    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 01:42:56.644048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:56.643988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:56.644048 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.644034    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls podName:5470ee1b-e719-4a61-b2aa-b5efb6f8942d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:58.644013017 +0000 UTC m=+41.009846737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls") pod "dns-default-hmnhz" (UID: "5470ee1b-e719-4a61-b2aa-b5efb6f8942d") : secret "dns-default-metrics-tls" not found
Jul 08 01:42:56.644151 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.644074    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 01:42:56.644151 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.644084    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d75f7867c-2qj2v: secret "image-registry-tls" not found
Jul 08 01:42:56.644151 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:56.644119    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls podName:692a83fa-c903-4b0e-90c5-55c01a4847b0 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:58.644109134 +0000 UTC m=+41.009942869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls") pod "image-registry-5d75f7867c-2qj2v" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0") : secret "image-registry-tls" not found
Jul 08 01:42:57.250610 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.250545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:57.251228 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:57.250772    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 01:42:57.251228 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:57.250838    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls podName:ce16e9fd-3879-47e0-bcff-044b6dfa3180 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:59.250819782 +0000 UTC m=+41.616653486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gbljk" (UID: "ce16e9fd-3879-47e0-bcff-044b6dfa3180") : secret "samples-operator-tls" not found
Jul 08 01:42:57.352432 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.351571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:57.352432 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.351900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:57.352432 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:57.351816    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 01:42:57.352432 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:57.352080    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls podName:bb9ca78d-379e-41fb-baed-0446060babb9 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:59.352060623 +0000 UTC m=+41.717894329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c7skd" (UID: "bb9ca78d-379e-41fb-baed-0446060babb9") : secret "cluster-monitoring-operator-tls" not found
Jul 08 01:42:57.352432 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.352121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:57.352432 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:57.352241    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 01:42:57.352432 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:57.352290    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:59.352275498 +0000 UTC m=+41.718109213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : secret "router-metrics-certs-default" not found
Jul 08 01:42:57.352432 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:57.352371    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:59.352359497 +0000 UTC m=+41.718193211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : configmap references non-existent config key: service-ca.crt
Jul 08 01:42:57.357583 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.357554    2582 generic.go:356] "Generic (PLEG): container finished" podID="bb986e71-ea1a-4767-8509-e039afcb753c" containerID="2a406ba304df9b8f85d54f4d2f90dcef46648fb4619711d3ec6d45330a239048" exitCode=0
Jul 08 01:42:57.357769 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.357676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" event={"ID":"bb986e71-ea1a-4767-8509-e039afcb753c","Type":"ContainerDied","Data":"2a406ba304df9b8f85d54f4d2f90dcef46648fb4619711d3ec6d45330a239048"}
Jul 08 01:42:57.360598 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.360550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" event={"ID":"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9","Type":"ContainerStarted","Data":"e2ef7b0876b96413bd2e2aa84f0139822f3584114ffa97f53dd88e9edea43ae7"}
Jul 08 01:42:57.364512 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.364102    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77" event={"ID":"e6436ac3-aade-42e2-9740-cc73adb66b91","Type":"ContainerStarted","Data":"185f66dc1c22c2177af9e553ec52876ddad01aa046521e9ae2be851734cd7256"}
Jul 08 01:42:57.365809 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.365694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w" event={"ID":"7ca7ad82-aab4-48dd-b885-f3e673aec8f1","Type":"ContainerStarted","Data":"335d67d4cf9085590db7e5cfa2e89ba9ce76cf51cd07c85f8c6e654b2e97419d"}
Jul 08 01:42:57.368338 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.368314    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485" event={"ID":"949f7197-dd85-4a7e-9e26-632696936f4c","Type":"ContainerStarted","Data":"72b2909c9e14c599b167d9d8e1020fc9e1fbaaf74f185b30718dfe81efba369c"}
Jul 08 01:42:57.372885 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.372819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv" event={"ID":"a01783bc-0824-4f3c-a7cf-ccc633c5a55b","Type":"ContainerStarted","Data":"49a08ca4b6090bf3db2137db971f0feb22eec877866a9ac77524a2ce0181c421"}
Jul 08 01:42:57.376262 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.376234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x9wr5" event={"ID":"cbd26fd0-e8ea-420f-9495-9a4de39d8213","Type":"ContainerStarted","Data":"8790d49eefbf618eb925a92ec0d84d368f1fcaab1f971f6685c6792d4c1c4461"}
Jul 08 01:42:57.385564 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:57.385487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf" event={"ID":"a547e197-12f8-4b9f-8a29-4943f7c740f7","Type":"ContainerStarted","Data":"4c1d235c54f731350a9e2e0b8b2506529550d9ee478315eb25169cc378ff82bf"}
Jul 08 01:42:58.402975 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:58.402119    2582 generic.go:356] "Generic (PLEG): container finished" podID="bb986e71-ea1a-4767-8509-e039afcb753c" containerID="c99a8eff3f5d5fc55f93cfa34785174d27f1f73fda2e40d5b286c03801874a7e" exitCode=0
Jul 08 01:42:58.402975 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:58.402186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" event={"ID":"bb986e71-ea1a-4767-8509-e039afcb753c","Type":"ContainerDied","Data":"c99a8eff3f5d5fc55f93cfa34785174d27f1f73fda2e40d5b286c03801874a7e"}
Jul 08 01:42:58.666094 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:58.666003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:42:58.671088 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:58.666144    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:42:58.671088 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:58.667610    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 01:42:58.671088 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:58.667771    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls podName:5470ee1b-e719-4a61-b2aa-b5efb6f8942d nodeName:}" failed. No retries permitted until 2026-07-08 01:43:02.667746794 +0000 UTC m=+45.033580516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls") pod "dns-default-hmnhz" (UID: "5470ee1b-e719-4a61-b2aa-b5efb6f8942d") : secret "dns-default-metrics-tls" not found
Jul 08 01:42:58.672747 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:58.672255    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 01:42:58.672747 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:58.672276    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d75f7867c-2qj2v: secret "image-registry-tls" not found
Jul 08 01:42:58.672747 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:58.672340    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls podName:692a83fa-c903-4b0e-90c5-55c01a4847b0 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:02.672320324 +0000 UTC m=+45.038154026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls") pod "image-registry-5d75f7867c-2qj2v" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0") : secret "image-registry-tls" not found
Jul 08 01:42:59.106666 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.106622    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:42:59.164806 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.164720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:42:59.273365 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.272942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:42:59.273365 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:59.273151    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 01:42:59.273365 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:59.273214    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls podName:ce16e9fd-3879-47e0-bcff-044b6dfa3180 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:03.273196709 +0000 UTC m=+45.639030415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gbljk" (UID: "ce16e9fd-3879-47e0-bcff-044b6dfa3180") : secret "samples-operator-tls" not found
Jul 08 01:42:59.373922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.373835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:59.373922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.373891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:42:59.374166 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.373930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:42:59.374166 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:59.373989    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 01:42:59.374166 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:59.374059    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:03.374041883 +0000 UTC m=+45.739875587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : secret "router-metrics-certs-default" not found
Jul 08 01:42:59.374166 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:59.374113    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:03.37410121 +0000 UTC m=+45.739934910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : configmap references non-existent config key: service-ca.crt
Jul 08 01:42:59.374404 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:59.374176    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 01:42:59.374404 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:42:59.374207    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls podName:bb9ca78d-379e-41fb-baed-0446060babb9 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:03.374197578 +0000 UTC m=+45.740031278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c7skd" (UID: "bb9ca78d-379e-41fb-baed-0446060babb9") : secret "cluster-monitoring-operator-tls" not found
Jul 08 01:42:59.409872 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.409807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" event={"ID":"bb986e71-ea1a-4767-8509-e039afcb753c","Type":"ContainerStarted","Data":"8f65a6501b3514a56004bfe9b78882f10eec5ee65d942b8937807f0b1c1ad6e5"}
Jul 08 01:42:59.440035 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.439757    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g5k5m" podStartSLOduration=9.94083398 podStartE2EDuration="41.439733883s" totalImagesPullingTime="31.498899903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:59.438335634 +0000 UTC m=+41.804169347" watchObservedRunningTime="2026-07-08 01:42:59.439733883 +0000 UTC m=+41.805567626"
Jul 08 01:42:59.562761 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.562727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:42:59.623661 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:42:59.623629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:00.804207 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:00.804159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:00.857976 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:00.857930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:02.704395 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:02.704351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:43:02.704820 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:02.704441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:43:02.704820 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:02.704510    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 01:43:02.704820 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:02.704533    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d75f7867c-2qj2v: secret "image-registry-tls" not found
Jul 08 01:43:02.704820 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:02.704583    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 01:43:02.704820 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:02.704588    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls podName:692a83fa-c903-4b0e-90c5-55c01a4847b0 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:10.704573766 +0000 UTC m=+53.070407470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls") pod "image-registry-5d75f7867c-2qj2v" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0") : secret "image-registry-tls" not found
Jul 08 01:43:02.704820 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:02.704637    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls podName:5470ee1b-e719-4a61-b2aa-b5efb6f8942d nodeName:}" failed. No retries permitted until 2026-07-08 01:43:10.704625594 +0000 UTC m=+53.070459294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls") pod "dns-default-hmnhz" (UID: "5470ee1b-e719-4a61-b2aa-b5efb6f8942d") : secret "dns-default-metrics-tls" not found
Jul 08 01:43:03.308806 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:03.308765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:43:03.308998 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:03.308912    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 01:43:03.308998 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:03.308972    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls podName:ce16e9fd-3879-47e0-bcff-044b6dfa3180 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:11.308953936 +0000 UTC m=+53.674787656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gbljk" (UID: "ce16e9fd-3879-47e0-bcff-044b6dfa3180") : secret "samples-operator-tls" not found
Jul 08 01:43:03.410203 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:03.410166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:43:03.410397 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:03.410215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:03.410397 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:03.410313    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 01:43:03.410397 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:03.410359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:03.410397 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:03.410382    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls podName:bb9ca78d-379e-41fb-baed-0446060babb9 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:11.410364136 +0000 UTC m=+53.776197837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c7skd" (UID: "bb9ca78d-379e-41fb-baed-0446060babb9") : secret "cluster-monitoring-operator-tls" not found
Jul 08 01:43:03.410634 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:03.410412    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 01:43:03.410634 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:03.410421    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:11.410401746 +0000 UTC m=+53.776235460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : configmap references non-existent config key: service-ca.crt
Jul 08 01:43:03.410634 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:03.410450    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:11.410443386 +0000 UTC m=+53.776277086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : secret "router-metrics-certs-default" not found
Jul 08 01:43:04.425164 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.425101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" event={"ID":"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9","Type":"ContainerStarted","Data":"4fff2900e601720eb414f6a9105a370d5981abdbdfeb1887f3eb54cea58de56c"}
Jul 08 01:43:04.426796 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.426728    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77" event={"ID":"e6436ac3-aade-42e2-9740-cc73adb66b91","Type":"ContainerStarted","Data":"2e4e39a15c72a3b3dae438168bb0f79c5307101324f64378d2567aa729378151"}
Jul 08 01:43:04.428447 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.428419    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w" event={"ID":"7ca7ad82-aab4-48dd-b885-f3e673aec8f1","Type":"ContainerStarted","Data":"aae2f76f74ec683b0e57dd18d4e3b46d3e9d33ddb075674d5ff0a35a275af109"}
Jul 08 01:43:04.430486 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.430440    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485" event={"ID":"949f7197-dd85-4a7e-9e26-632696936f4c","Type":"ContainerStarted","Data":"8b02d4cc3497beb03bee8b5fc1d991e4689b19581a8cd565e80cbb699bda2c34"}
Jul 08 01:43:04.463175 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.463109    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77" podStartSLOduration=1.7315401719999999 podStartE2EDuration="9.463088434s" totalImagesPullingTime="7.731548262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:04.461421764 +0000 UTC m=+46.827255489" watchObservedRunningTime="2026-07-08 01:43:04.463088434 +0000 UTC m=+46.828922155"
Jul 08 01:43:04.477204 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.477104    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-nsn2w" podStartSLOduration=1.846903974 podStartE2EDuration="9.477085786s" totalImagesPullingTime="7.630181812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:04.477018747 +0000 UTC m=+46.842852470" watchObservedRunningTime="2026-07-08 01:43:04.477085786 +0000 UTC m=+46.842919509"
Jul 08 01:43:04.495546 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.495489    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" podStartSLOduration=1.7471146389999999 podStartE2EDuration="9.495471599s" totalImagesPullingTime="7.74835696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:04.495065387 +0000 UTC m=+46.860899110" watchObservedRunningTime="2026-07-08 01:43:04.495471599 +0000 UTC m=+46.861305332"
Jul 08 01:43:04.558701 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.558618    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:04.659949 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:04.659909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:05.435912 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.435866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf" event={"ID":"a547e197-12f8-4b9f-8a29-4943f7c740f7","Type":"ContainerStarted","Data":"a4f77f8d52d66c6107f88bdbafb02d07900c3cb075e55f4997e5a3981734feac"}
Jul 08 01:43:05.437289 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.437264    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/0.log"
Jul 08 01:43:05.437394 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.437308    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a09e13c-2839-42f4-9bda-5dbd0c89c9c9" containerID="4fff2900e601720eb414f6a9105a370d5981abdbdfeb1887f3eb54cea58de56c" exitCode=255
Jul 08 01:43:05.437548 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.437495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" event={"ID":"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9","Type":"ContainerDied","Data":"4fff2900e601720eb414f6a9105a370d5981abdbdfeb1887f3eb54cea58de56c"}
Jul 08 01:43:05.437695 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.437680    2582 scope.go:117] "RemoveContainer" containerID="4fff2900e601720eb414f6a9105a370d5981abdbdfeb1887f3eb54cea58de56c"
Jul 08 01:43:05.439186 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.439154    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv" event={"ID":"a01783bc-0824-4f3c-a7cf-ccc633c5a55b","Type":"ContainerStarted","Data":"6d1fe09a611503eb673e9e94815838b06bda38ad44b552d08a4d2cdec3366062"}
Jul 08 01:43:05.442761 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.442739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x9wr5" event={"ID":"cbd26fd0-e8ea-420f-9495-9a4de39d8213","Type":"ContainerStarted","Data":"845b4f466550dad40d65d6cf7aaa6010dc0cef70585c703c6dfaf0eb2e9495c4"}
Jul 08 01:43:05.460456 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.460401    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-lscpf" podStartSLOduration=2.709400472 podStartE2EDuration="10.460378768s" totalImagesPullingTime="7.750978296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:05.458076858 +0000 UTC m=+47.823910578" watchObservedRunningTime="2026-07-08 01:43:05.460378768 +0000 UTC m=+47.826212490"
Jul 08 01:43:05.482606 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.482549    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x9wr5" podStartSLOduration=3.738662448 podStartE2EDuration="11.48253275s" totalImagesPullingTime="7.743870302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:05.481754782 +0000 UTC m=+47.847588504" watchObservedRunningTime="2026-07-08 01:43:05.48253275 +0000 UTC m=+47.848366473"
Jul 08 01:43:05.526012 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.525417    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485" podStartSLOduration=2.762021062 podStartE2EDuration="10.525395961s" totalImagesPullingTime="7.763374899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:05.500610243 +0000 UTC m=+47.866443963" watchObservedRunningTime="2026-07-08 01:43:05.525395961 +0000 UTC m=+47.891229685"
Jul 08 01:43:05.543918 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.543860    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv" podStartSLOduration=2.821475827 podStartE2EDuration="10.543844157s" totalImagesPullingTime="7.72236833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:05.542870173 +0000 UTC m=+47.908703897" watchObservedRunningTime="2026-07-08 01:43:05.543844157 +0000 UTC m=+47.909677879"
Jul 08 01:43:05.755592 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.755551    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4kg58"]
Jul 08 01:43:05.769236 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.769153    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.773433 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.773236    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 01:43:05.774110 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.773884    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 01:43:05.774110 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.774036    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wwxml\""
Jul 08 01:43:05.775515 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.775448    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4kg58"]
Jul 08 01:43:05.803563 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.803529    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:05.833978 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.833944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/438cf5d5-0436-422d-9424-e58bb52ac313-data-volume\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.834178 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.833985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/438cf5d5-0436-422d-9424-e58bb52ac313-crio-socket\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.834178 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.834101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.834178 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.834162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tnpt\" (UniqueName: \"kubernetes.io/projected/438cf5d5-0436-422d-9424-e58bb52ac313-kube-api-access-2tnpt\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.834325 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.834247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.836826 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.836799    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:43:05.871196 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.871141    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:05.934814 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.934780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.934982 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.934826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tnpt\" (UniqueName: \"kubernetes.io/projected/438cf5d5-0436-422d-9424-e58bb52ac313-kube-api-access-2tnpt\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.934982 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:05.934943    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:05.935053 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.934999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.935053 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:05.935011    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:06.434992743 +0000 UTC m=+48.800826461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:05.935155 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:05.935138    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 01:43:05.935193 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.935168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/438cf5d5-0436-422d-9424-e58bb52ac313-data-volume\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.935233 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:05.935200    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:06.435181978 +0000 UTC m=+48.801015683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : configmap "kube-rbac-proxy" not found
Jul 08 01:43:05.935275 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.935242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/438cf5d5-0436-422d-9424-e58bb52ac313-crio-socket\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.935448 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.935432    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/438cf5d5-0436-422d-9424-e58bb52ac313-data-volume\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.935488 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.935438    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/438cf5d5-0436-422d-9424-e58bb52ac313-crio-socket\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.948653 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.948627    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tnpt\" (UniqueName: \"kubernetes.io/projected/438cf5d5-0436-422d-9424-e58bb52ac313-kube-api-access-2tnpt\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:05.970981 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:05.970950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:06.031266 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.031183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:06.325198 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.325090    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:06.364894 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.364864    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7"]
Jul 08 01:43:06.387092 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.387070    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7"]
Jul 08 01:43:06.387227 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.387162    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7"
Jul 08 01:43:06.390077 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.390052    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 01:43:06.390239 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.390225    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 01:43:06.390447 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.390432    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kxdxr\""
Jul 08 01:43:06.407532 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.407508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:06.441186 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.441165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:06.441474 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.441249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:06.441474 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.441292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vdrm\" (UniqueName: \"kubernetes.io/projected/e08708df-873e-4877-be3c-f3c86d50620c-kube-api-access-8vdrm\") pod \"migrator-d57d58cc9-ht6g7\" (UID: \"e08708df-873e-4877-be3c-f3c86d50620c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7"
Jul 08 01:43:06.441474 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:06.441304    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:06.441474 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:06.441332    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 01:43:06.441474 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:06.441352    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:07.441339414 +0000 UTC m=+49.807173114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:06.441474 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:06.441376    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:07.441363022 +0000 UTC m=+49.807196722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : configmap "kube-rbac-proxy" not found
Jul 08 01:43:06.448127 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.448109    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 01:43:06.448515 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.448500    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/0.log"
Jul 08 01:43:06.448591 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.448530    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a09e13c-2839-42f4-9bda-5dbd0c89c9c9" containerID="2e50154c9ea69e9b24de2463b06afa344dfaa5be4a3b82343e6dbc9e2e09981d" exitCode=255
Jul 08 01:43:06.448637 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.448598    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" event={"ID":"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9","Type":"ContainerDied","Data":"2e50154c9ea69e9b24de2463b06afa344dfaa5be4a3b82343e6dbc9e2e09981d"}
Jul 08 01:43:06.448637 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.448633    2582 scope.go:117] "RemoveContainer" containerID="4fff2900e601720eb414f6a9105a370d5981abdbdfeb1887f3eb54cea58de56c"
Jul 08 01:43:06.448855 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.448835    2582 scope.go:117] "RemoveContainer" containerID="2e50154c9ea69e9b24de2463b06afa344dfaa5be4a3b82343e6dbc9e2e09981d"
Jul 08 01:43:06.449044 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:06.449021    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-kjx2n_openshift-console-operator(8a09e13c-2839-42f4-9bda-5dbd0c89c9c9)\"" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" podUID="8a09e13c-2839-42f4-9bda-5dbd0c89c9c9"
Jul 08 01:43:06.476211 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.476185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:06.541983 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.541953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vdrm\" (UniqueName: \"kubernetes.io/projected/e08708df-873e-4877-be3c-f3c86d50620c-kube-api-access-8vdrm\") pod \"migrator-d57d58cc9-ht6g7\" (UID: \"e08708df-873e-4877-be3c-f3c86d50620c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7"
Jul 08 01:43:06.551190 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.551161    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vdrm\" (UniqueName: \"kubernetes.io/projected/e08708df-873e-4877-be3c-f3c86d50620c-kube-api-access-8vdrm\") pod \"migrator-d57d58cc9-ht6g7\" (UID: \"e08708df-873e-4877-be3c-f3c86d50620c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7"
Jul 08 01:43:06.696329 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.696296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7"
Jul 08 01:43:06.700920 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.700896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:06.801604 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.801483    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:06.845737 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.845281    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7"]
Jul 08 01:43:06.850617 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:06.850593    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08708df_873e_4877_be3c_f3c86d50620c.slice/crio-cc91bd66654ffd59d1ab30cebe58f57a871e008c8cbc6a202700b1cc690499dd WatchSource:0}: Error finding container cc91bd66654ffd59d1ab30cebe58f57a871e008c8cbc6a202700b1cc690499dd: Status 404 returned error can't find the container with id cc91bd66654ffd59d1ab30cebe58f57a871e008c8cbc6a202700b1cc690499dd
Jul 08 01:43:06.961400 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:06.961329    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kls9s_9e50e08d-503e-4439-8c9d-37077570c073/dns-node-resolver/0.log"
Jul 08 01:43:07.451682 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:07.451653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:07.452075 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:07.451757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:07.452075 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:07.451802    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:07.452075 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:07.451850    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 01:43:07.452075 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:07.451858    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:09.451843713 +0000 UTC m=+51.817677414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:07.452075 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:07.451888    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:09.451876799 +0000 UTC m=+51.817710498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : configmap "kube-rbac-proxy" not found
Jul 08 01:43:07.453525 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:07.453495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7" event={"ID":"e08708df-873e-4877-be3c-f3c86d50620c","Type":"ContainerStarted","Data":"cc91bd66654ffd59d1ab30cebe58f57a871e008c8cbc6a202700b1cc690499dd"}
Jul 08 01:43:07.454947 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:07.454930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 01:43:07.455239 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:07.455224    2582 scope.go:117] "RemoveContainer" containerID="2e50154c9ea69e9b24de2463b06afa344dfaa5be4a3b82343e6dbc9e2e09981d"
Jul 08 01:43:07.455372 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:07.455354    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-kjx2n_openshift-console-operator(8a09e13c-2839-42f4-9bda-5dbd0c89c9c9)\"" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" podUID="8a09e13c-2839-42f4-9bda-5dbd0c89c9c9"
Jul 08 01:43:07.761656 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:07.761578    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2t5qg_4a123056-ddd1-438a-99f5-015ea95bbdd4/node-ca/0.log"
Jul 08 01:43:08.269568 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.269530    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-2cl8g"]
Jul 08 01:43:08.288554 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.288517    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-2cl8g"]
Jul 08 01:43:08.288695 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.288636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.291412 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.291385    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 01:43:08.291559 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.291489    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 01:43:08.291559 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.291534    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 01:43:08.292786 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.292767    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 01:43:08.292906 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.292864    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pvzqt\""
Jul 08 01:43:08.307819 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.307795    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:08.362083 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.362050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sg7g\" (UniqueName: \"kubernetes.io/projected/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-kube-api-access-4sg7g\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.362261 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.362116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-signing-cabundle\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.362261 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.362227    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-signing-key\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.366634 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.366598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:08.463718 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.463666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sg7g\" (UniqueName: \"kubernetes.io/projected/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-kube-api-access-4sg7g\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.464167 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.463765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-signing-cabundle\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.464167 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.463977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-signing-key\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.464564 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.464537    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-signing-cabundle\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.466741 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.466721    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-signing-key\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.472291 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.472263    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sg7g\" (UniqueName: \"kubernetes.io/projected/f1dfd3f9-d19b-47a8-b15c-d9beac17a782-kube-api-access-4sg7g\") pod \"service-ca-758f599c5-2cl8g\" (UID: \"f1dfd3f9-d19b-47a8-b15c-d9beac17a782\") " pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.561838 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.561752    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x9wr5_cbd26fd0-e8ea-420f-9495-9a4de39d8213/serve-healthcheck-canary/0.log"
Jul 08 01:43:08.598460 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.598419    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-2cl8g"
Jul 08 01:43:08.758742 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:08.758699    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-2cl8g"]
Jul 08 01:43:08.760935 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:08.760900    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dfd3f9_d19b_47a8_b15c_d9beac17a782.slice/crio-b26056fdc40e4ea758d4967d0d5a1d46e638e7ee0603affbe33e7cb293a68a9b WatchSource:0}: Error finding container b26056fdc40e4ea758d4967d0d5a1d46e638e7ee0603affbe33e7cb293a68a9b: Status 404 returned error can't find the container with id b26056fdc40e4ea758d4967d0d5a1d46e638e7ee0603affbe33e7cb293a68a9b
Jul 08 01:43:09.220228 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.220181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:09.467224 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.467187    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7" event={"ID":"e08708df-873e-4877-be3c-f3c86d50620c","Type":"ContainerStarted","Data":"5b7b9a265821c54c05e2fa2b58b383d4a2d0a97a05c3639a717bd0bf5f71c2b1"}
Jul 08 01:43:09.467691 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.467279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7" event={"ID":"e08708df-873e-4877-be3c-f3c86d50620c","Type":"ContainerStarted","Data":"9fb71ea77a0a5ac697a15381d5c58bf878f6220b3cf656197ad0a1248b5db0d3"}
Jul 08 01:43:09.469312 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.469284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-2cl8g" event={"ID":"f1dfd3f9-d19b-47a8-b15c-d9beac17a782","Type":"ContainerStarted","Data":"5fa1d32234dbe10c26f6826be1fe93fce294904c6394c8d7585ed9db3c8c1e09"}
Jul 08 01:43:09.469417 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.469330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-2cl8g" event={"ID":"f1dfd3f9-d19b-47a8-b15c-d9beac17a782","Type":"ContainerStarted","Data":"b26056fdc40e4ea758d4967d0d5a1d46e638e7ee0603affbe33e7cb293a68a9b"}
Jul 08 01:43:09.474413 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.474389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:09.474542 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:09.474525    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:09.474594 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.474577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:09.474594 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:09.474588    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:13.474574613 +0000 UTC m=+55.840408313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:09.474693 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:09.474678    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 01:43:09.474746 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:09.474740    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:13.474729333 +0000 UTC m=+55.840563032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : configmap "kube-rbac-proxy" not found
Jul 08 01:43:09.503229 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.503184    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-ht6g7" podStartSLOduration=1.412095004 podStartE2EDuration="3.503169588s" totalImagesPullingTime="2.091074584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:09.485174236 +0000 UTC m=+51.851007958" watchObservedRunningTime="2026-07-08 01:43:09.503169588 +0000 UTC m=+51.869003374"
Jul 08 01:43:09.503447 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.503422    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-2cl8g" podStartSLOduration=1.503413294 podStartE2EDuration="1.503413294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:09.502592683 +0000 UTC m=+51.868426405" watchObservedRunningTime="2026-07-08 01:43:09.503413294 +0000 UTC m=+51.869247016"
Jul 08 01:43:09.918032 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:09.917946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:10.015824 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:10.015788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:10.118188 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:10.118151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:10.224442 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:10.224405    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:10.332673 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:10.332638    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:10.624772 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:10.624682    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:10.789341 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:10.789301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:43:10.789519 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:10.789405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:43:10.789519 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:10.789464    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 01:43:10.789519 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:10.789481    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d75f7867c-2qj2v: secret "image-registry-tls" not found
Jul 08 01:43:10.789646 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:10.789543    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 01:43:10.789646 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:10.789546    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls podName:692a83fa-c903-4b0e-90c5-55c01a4847b0 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:26.789531595 +0000 UTC m=+69.155365295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls") pod "image-registry-5d75f7867c-2qj2v" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0") : secret "image-registry-tls" not found
Jul 08 01:43:10.789646 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:10.789633    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls podName:5470ee1b-e719-4a61-b2aa-b5efb6f8942d nodeName:}" failed. No retries permitted until 2026-07-08 01:43:26.789616987 +0000 UTC m=+69.155450691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls") pod "dns-default-hmnhz" (UID: "5470ee1b-e719-4a61-b2aa-b5efb6f8942d") : secret "dns-default-metrics-tls" not found
Jul 08 01:43:11.394947 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:11.394913    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:43:11.397227 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:11.397207    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce16e9fd-3879-47e0-bcff-044b6dfa3180-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gbljk\" (UID: \"ce16e9fd-3879-47e0-bcff-044b6dfa3180\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:43:11.407120 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:11.407099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"
Jul 08 01:43:11.496386 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:11.496354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:11.496530 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:11.496396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:43:11.496530 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:11.496421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:11.496647 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:11.496525    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 01:43:11.496647 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:11.496564    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:27.496551612 +0000 UTC m=+69.862385312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : configmap references non-existent config key: service-ca.crt
Jul 08 01:43:11.496647 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:11.496596    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls podName:bb9ca78d-379e-41fb-baed-0446060babb9 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:27.496575496 +0000 UTC m=+69.862409216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c7skd" (UID: "bb9ca78d-379e-41fb-baed-0446060babb9") : secret "cluster-monitoring-operator-tls" not found
Jul 08 01:43:11.496647 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:11.496525    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 01:43:11.496647 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:11.496635    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs podName:f2138832-8c0b-47ac-a7ea-2ac8ee294447 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:27.496625151 +0000 UTC m=+69.862458853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs") pod "router-default-6d948f6b97-b56nd" (UID: "f2138832-8c0b-47ac-a7ea-2ac8ee294447") : secret "router-metrics-certs-default" not found
Jul 08 01:43:11.528124 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:11.528100    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk"]
Jul 08 01:43:11.824420 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:11.824391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:12.027981 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:12.027949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:12.226375 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:12.226323    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:12.454177 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:12.454136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:12.482927 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:12.482833    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk" event={"ID":"ce16e9fd-3879-47e0-bcff-044b6dfa3180","Type":"ContainerStarted","Data":"b7e966248a8ddbb03ad3b43751a078e1d45d03877fcc779b5f5a773277d3f2fc"}
Jul 08 01:43:12.635701 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:12.635642    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:12.931372 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:12.931282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:13.517073 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:13.517049    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:13.517257 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:13.517240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:13.517368 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:13.517356    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:13.517415 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:13.517406    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls podName:438cf5d5-0436-422d-9424-e58bb52ac313 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:21.517395088 +0000 UTC m=+63.883228788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4kg58" (UID: "438cf5d5-0436-422d-9424-e58bb52ac313") : secret "insights-runtime-extractor-tls" not found
Jul 08 01:43:13.517517 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:13.517501    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/438cf5d5-0436-422d-9424-e58bb52ac313-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:13.540430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:13.540403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:13.640937 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:13.640906    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:13.743894 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:13.743800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:13.840744 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:13.840698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:14.035757 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:14.035663    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:14.134575 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:14.134545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:14.231209 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:14.231169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:14.447445 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:14.447417    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:43:14.447844 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:14.447830    2582 scope.go:117] "RemoveContainer" containerID="2e50154c9ea69e9b24de2463b06afa344dfaa5be4a3b82343e6dbc9e2e09981d"
Jul 08 01:43:14.447998 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:14.447978    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-kjx2n_openshift-console-operator(8a09e13c-2839-42f4-9bda-5dbd0c89c9c9)\"" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" podUID="8a09e13c-2839-42f4-9bda-5dbd0c89c9c9"
Jul 08 01:43:14.490010 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:14.489976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk" event={"ID":"ce16e9fd-3879-47e0-bcff-044b6dfa3180","Type":"ContainerStarted","Data":"c7f84bac42e204377c1a1c825a78b7738dab0041cb7731628eb93247a53e23f4"}
Jul 08 01:43:14.490168 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:14.490039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk" event={"ID":"ce16e9fd-3879-47e0-bcff-044b6dfa3180","Type":"ContainerStarted","Data":"01ff934deb41b10b7edba96f9f97e4a5c1b3fe859e387c3a3c69d03b57b36564"}
Jul 08 01:43:14.508054 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:14.508005    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gbljk" podStartSLOduration=17.61787327 podStartE2EDuration="19.507990361s" totalImagesPullingTime="1.890117091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:14.50707414 +0000 UTC m=+56.872907863" watchObservedRunningTime="2026-07-08 01:43:14.507990361 +0000 UTC m=+56.873824088"
Jul 08 01:43:15.228130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:15.228100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:15.675474 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:15.675393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:15.814450 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:15.814400    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:15.836532 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:15.836497    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:43:15.836885 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:15.836870    2582 scope.go:117] "RemoveContainer" containerID="2e50154c9ea69e9b24de2463b06afa344dfaa5be4a3b82343e6dbc9e2e09981d"
Jul 08 01:43:15.914515 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:15.914484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:16.037922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:16.037885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:16.264097 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:16.264065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:16.384408 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:16.384337    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:16.498298 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:16.498273    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 01:43:16.498559 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:16.498352    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n" event={"ID":"8a09e13c-2839-42f4-9bda-5dbd0c89c9c9","Type":"ContainerStarted","Data":"4bb78afd03574289454618b3249ae73da9eb3405b84bcfca886b56e872f4699d"}
Jul 08 01:43:16.498680 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:16.498654    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:43:16.913640 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:16.913610    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-kjx2n"
Jul 08 01:43:17.206997 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:17.206866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:17.283843 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:17.283805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:17.413465 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:17.413428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:17.635685 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:17.635591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:17.780332 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:17.780302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:17.880684 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:17.880650    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:18.028638 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:18.028601    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:18.287255 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:18.287175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:18.348821 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:18.348791    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:18.840621 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:18.840587    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:19.047257 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:19.047214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:19.261428 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:19.261401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:19.351844 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:19.351812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:19.442062 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:19.442028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:19.651186 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:19.651097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:19.830365 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:19.830329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:20.034126 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:20.034088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:20.246540 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:20.246512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:20.321281 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:20.321205    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dm8hs"
Jul 08 01:43:20.554008 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:20.553973    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:20.833262 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:20.833228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:21.031613 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:21.031574    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:21.590729 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:21.590666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:21.593012 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:21.592981    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/438cf5d5-0436-422d-9424-e58bb52ac313-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4kg58\" (UID: \"438cf5d5-0436-422d-9424-e58bb52ac313\") " pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:21.684049 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:21.684014    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wwxml\""
Jul 08 01:43:21.691636 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:21.691609    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4kg58"
Jul 08 01:43:21.815877 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:21.815847    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4kg58"]
Jul 08 01:43:21.818677 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:21.818641    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438cf5d5_0436_422d_9424_e58bb52ac313.slice/crio-769c3f0d08990718671e5ad0082bae6126cd9203bd3731a116d49a301fe6cf5b WatchSource:0}: Error finding container 769c3f0d08990718671e5ad0082bae6126cd9203bd3731a116d49a301fe6cf5b: Status 404 returned error can't find the container with id 769c3f0d08990718671e5ad0082bae6126cd9203bd3731a116d49a301fe6cf5b
Jul 08 01:43:22.523290 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:22.523246    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kg58" event={"ID":"438cf5d5-0436-422d-9424-e58bb52ac313","Type":"ContainerStarted","Data":"769c3f0d08990718671e5ad0082bae6126cd9203bd3731a116d49a301fe6cf5b"}
Jul 08 01:43:24.922517 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:24.922480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:43:24.925371 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:24.925341    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlhhq\" (UniqueName: \"kubernetes.io/projected/8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2-kube-api-access-jlhhq\") pod \"network-check-target-95trb\" (UID: \"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2\") " pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:43:25.008387 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.008360    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2x5xt\""
Jul 08 01:43:25.016810 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.016771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:43:25.023449 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.023410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:43:25.023628 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.023475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:43:25.026675 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.026639    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 01:43:25.026801 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.026645    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 01:43:25.036352 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.036328    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7833b36c-c519-4737-8bf8-e63feee36e20-original-pull-secret\") pod \"global-pull-secret-syncer-cmvbh\" (UID: \"7833b36c-c519-4737-8bf8-e63feee36e20\") " pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:43:25.036465 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.036390    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51350b5f-d0b4-4b03-93ba-92bcbe31deeb-metrics-certs\") pod \"network-metrics-daemon-pv6z5\" (UID: \"51350b5f-d0b4-4b03-93ba-92bcbe31deeb\") " pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:43:25.318428 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.318389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cmvbh"
Jul 08 01:43:25.330478 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.330448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkcps\""
Jul 08 01:43:25.338760 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.338735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pv6z5"
Jul 08 01:43:25.652109 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.652051    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-95trb"]
Jul 08 01:43:25.654768 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:25.654745    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7e7f37_4e9e_4a25_b4f3_ca7115c12da2.slice/crio-9d5a586761ffde50a42350fea9da3dca38642f790f60e5c0a80ac7759b12d209 WatchSource:0}: Error finding container 9d5a586761ffde50a42350fea9da3dca38642f790f60e5c0a80ac7759b12d209: Status 404 returned error can't find the container with id 9d5a586761ffde50a42350fea9da3dca38642f790f60e5c0a80ac7759b12d209
Jul 08 01:43:25.868401 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.868319    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cmvbh"]
Jul 08 01:43:25.871386 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:25.871313    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7833b36c_c519_4737_8bf8_e63feee36e20.slice/crio-b17d5026d53a3173b2b6bc164a88df267bb2737ee232698443d6d708b7245349 WatchSource:0}: Error finding container b17d5026d53a3173b2b6bc164a88df267bb2737ee232698443d6d708b7245349: Status 404 returned error can't find the container with id b17d5026d53a3173b2b6bc164a88df267bb2737ee232698443d6d708b7245349
Jul 08 01:43:25.871386 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:25.871369    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pv6z5"]
Jul 08 01:43:26.539334 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.539239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pv6z5" event={"ID":"51350b5f-d0b4-4b03-93ba-92bcbe31deeb","Type":"ContainerStarted","Data":"af97e7156d96ec7e159f6e862d60cd0ffafc9cd4a423146c667622b0efab6ef7"}
Jul 08 01:43:26.541050 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.541023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-95trb" event={"ID":"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2","Type":"ContainerStarted","Data":"c46c6d819514e6df61a866ff2f67501bf994657a0db0d62bd0223949541a6589"}
Jul 08 01:43:26.541200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.541076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-95trb" event={"ID":"8c7e7f37-4e9e-4a25-b4f3-ca7115c12da2","Type":"ContainerStarted","Data":"9d5a586761ffde50a42350fea9da3dca38642f790f60e5c0a80ac7759b12d209"}
Jul 08 01:43:26.541200 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.541132    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:43:26.543338 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.543309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kg58" event={"ID":"438cf5d5-0436-422d-9424-e58bb52ac313","Type":"ContainerStarted","Data":"b6aa6f20d54af4aecca488969628acf8265b403fe437b43f2ada9b35fda7744f"}
Jul 08 01:43:26.543462 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.543363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kg58" event={"ID":"438cf5d5-0436-422d-9424-e58bb52ac313","Type":"ContainerStarted","Data":"36a32ed9e34b14c9d448c34fe9136d6961f4c59d3299352dd49c317c65d45918"}
Jul 08 01:43:26.544569 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.544539    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cmvbh" event={"ID":"7833b36c-c519-4737-8bf8-e63feee36e20","Type":"ContainerStarted","Data":"b17d5026d53a3173b2b6bc164a88df267bb2737ee232698443d6d708b7245349"}
Jul 08 01:43:26.559393 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.559336    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-95trb" podStartSLOduration=68.559315598 podStartE2EDuration="1m8.559315598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:26.557811868 +0000 UTC m=+68.923645590" watchObservedRunningTime="2026-07-08 01:43:26.559315598 +0000 UTC m=+68.925149303"
Jul 08 01:43:26.839881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.839793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:43:26.840023 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.839932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:43:26.842598 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.842566    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5470ee1b-e719-4a61-b2aa-b5efb6f8942d-metrics-tls\") pod \"dns-default-hmnhz\" (UID: \"5470ee1b-e719-4a61-b2aa-b5efb6f8942d\") " pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:43:26.842797 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:26.842776    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"image-registry-5d75f7867c-2qj2v\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") " pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:43:27.011101 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.011064    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-65qmt\""
Jul 08 01:43:27.018738 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.018664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:43:27.020383 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.020356    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v5bn9\""
Jul 08 01:43:27.027738 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.027698    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:43:27.281616 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.281590    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d75f7867c-2qj2v"]
Jul 08 01:43:27.288373 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:27.288340    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692a83fa_c903_4b0e_90c5_55c01a4847b0.slice/crio-e41d48590e3bbc8cd0bac3f7d127a243fbbaf23bc0e86961f6235e918d28acd0 WatchSource:0}: Error finding container e41d48590e3bbc8cd0bac3f7d127a243fbbaf23bc0e86961f6235e918d28acd0: Status 404 returned error can't find the container with id e41d48590e3bbc8cd0bac3f7d127a243fbbaf23bc0e86961f6235e918d28acd0
Jul 08 01:43:27.291426 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.291387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:27.304763 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.304452    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmnhz"]
Jul 08 01:43:27.309226 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:27.309194    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5470ee1b_e719_4a61_b2aa_b5efb6f8942d.slice/crio-55d1966e3566e4543570b656f804663720f44d8780b4c2007098bfdaa248570d WatchSource:0}: Error finding container 55d1966e3566e4543570b656f804663720f44d8780b4c2007098bfdaa248570d: Status 404 returned error can't find the container with id 55d1966e3566e4543570b656f804663720f44d8780b4c2007098bfdaa248570d
Jul 08 01:43:27.349432 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.349404    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:27.550234 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.550202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:27.550733 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.550258    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:43:27.550733 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.550291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:27.551056 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.551030    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2138832-8c0b-47ac-a7ea-2ac8ee294447-service-ca-bundle\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:27.552884 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.552850    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v" event={"ID":"692a83fa-c903-4b0e-90c5-55c01a4847b0","Type":"ContainerStarted","Data":"d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb"}
Jul 08 01:43:27.552980 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.552914    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v" event={"ID":"692a83fa-c903-4b0e-90c5-55c01a4847b0","Type":"ContainerStarted","Data":"e41d48590e3bbc8cd0bac3f7d127a243fbbaf23bc0e86961f6235e918d28acd0"}
Jul 08 01:43:27.553654 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.553629    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:43:27.555244 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.555196    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2138832-8c0b-47ac-a7ea-2ac8ee294447-metrics-certs\") pod \"router-default-6d948f6b97-b56nd\" (UID: \"f2138832-8c0b-47ac-a7ea-2ac8ee294447\") " pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:27.556903 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.556869    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb9ca78d-379e-41fb-baed-0446060babb9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c7skd\" (UID: \"bb9ca78d-379e-41fb-baed-0446060babb9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:43:27.557642 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.557618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pv6z5" event={"ID":"51350b5f-d0b4-4b03-93ba-92bcbe31deeb","Type":"ContainerStarted","Data":"cf29993e937d206a157f3a8047d083bcad9669cf35891df6a7bda2732d048676"}
Jul 08 01:43:27.557753 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.557668    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pv6z5" event={"ID":"51350b5f-d0b4-4b03-93ba-92bcbe31deeb","Type":"ContainerStarted","Data":"c876ca75f9f4192dab3e5fb507a7a7262b89b9790e3a3aee4d32a698f10a7eb7"}
Jul 08 01:43:27.559637 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.559603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmnhz" event={"ID":"5470ee1b-e719-4a61-b2aa-b5efb6f8942d","Type":"ContainerStarted","Data":"55d1966e3566e4543570b656f804663720f44d8780b4c2007098bfdaa248570d"}
Jul 08 01:43:27.575821 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.575775    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v" podStartSLOduration=69.575756474 podStartE2EDuration="1m9.575756474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:27.575032072 +0000 UTC m=+69.940865794" watchObservedRunningTime="2026-07-08 01:43:27.575756474 +0000 UTC m=+69.941590199"
Jul 08 01:43:27.717999 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.717916    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jmsk6\""
Jul 08 01:43:27.726048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.726009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"
Jul 08 01:43:27.754799 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.754399    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mkwld\""
Jul 08 01:43:27.762828 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.762798    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:27.925758 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.925277    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pv6z5" podStartSLOduration=68.643385837 podStartE2EDuration="1m9.925251465s" totalImagesPullingTime="1.281865628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:27.592856213 +0000 UTC m=+69.958689936" watchObservedRunningTime="2026-07-08 01:43:27.925251465 +0000 UTC m=+70.291085189"
Jul 08 01:43:27.925758 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.925651    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd"]
Jul 08 01:43:27.943844 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.943191    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"]
Jul 08 01:43:27.949893 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.949864    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"]
Jul 08 01:43:27.952046 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.952025    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"
Jul 08 01:43:27.955021 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.954796    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vdsvk\""
Jul 08 01:43:27.955021 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.954946    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"]
Jul 08 01:43:27.955184 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.955052    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 08 01:43:27.955184 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.955057    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 08 01:43:27.955321 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.955304    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:27.959318 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.959297    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 01:43:27.960794 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.960756    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 01:43:27.961677 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.961658    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 01:43:27.963556 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.961938    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 01:43:27.965519 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.964862    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"]
Jul 08 01:43:27.967540 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.966286    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:27.970973 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.970420    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 01:43:27.970973 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.970692    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 01:43:27.970973 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.970868    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 01:43:27.972489 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.971357    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 01:43:27.974871 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.974288    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"]
Jul 08 01:43:27.974871 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.974338    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"]
Jul 08 01:43:27.974871 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.974365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"]
Jul 08 01:43:27.974871 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.974451    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"
Jul 08 01:43:27.981613 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.981564    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-zlptl\""
Jul 08 01:43:27.981918 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.981882    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 01:43:27.983609 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:27.983557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"]
Jul 08 01:43:28.021010 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.020992    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d948f6b97-b56nd"]
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7rcq\" (UniqueName: \"kubernetes.io/projected/562a037a-a3a5-4b15-8991-f17d95ff4dd7-kube-api-access-q7rcq\") pod \"managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn\" (UID: \"562a037a-a3a5-4b15-8991-f17d95ff4dd7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648f4790-58a1-4562-bcd3-21ff7a19f42b-tmp\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e15e1dd8-bc81-408a-80eb-465c0c466432-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-75cq8\" (UID: \"e15e1dd8-bc81-408a-80eb-465c0c466432\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-hub\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/562a037a-a3a5-4b15-8991-f17d95ff4dd7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn\" (UID: \"562a037a-a3a5-4b15-8991-f17d95ff4dd7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2444472e-0027-4ba9-99dc-bc7fa65b8904-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txr4m\" (UniqueName: \"kubernetes.io/projected/648f4790-58a1-4562-bcd3-21ff7a19f42b-kube-api-access-txr4m\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd8pv\" (UniqueName: \"kubernetes.io/projected/2444472e-0027-4ba9-99dc-bc7fa65b8904-kube-api-access-kd8pv\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-ca\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.054871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/648f4790-58a1-4562-bcd3-21ff7a19f42b-klusterlet-config\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.055048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.055006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e15e1dd8-bc81-408a-80eb-465c0c466432-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-75cq8\" (UID: \"e15e1dd8-bc81-408a-80eb-465c0c466432\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"
Jul 08 01:43:28.073322 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.073294    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:28.076414 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.076386    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-8r8ct"]
Jul 08 01:43:28.115987 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.113788    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-8r8ct"]
Jul 08 01:43:28.115987 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.113901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-8r8ct"
Jul 08 01:43:28.117845 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.117805    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-f22d6\""
Jul 08 01:43:28.118174 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.118110    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 01:43:28.121237 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.120479    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 01:43:28.156198 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e15e1dd8-bc81-408a-80eb-465c0c466432-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-75cq8\" (UID: \"e15e1dd8-bc81-408a-80eb-465c0c466432\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"
Jul 08 01:43:28.156346 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7rcq\" (UniqueName: \"kubernetes.io/projected/562a037a-a3a5-4b15-8991-f17d95ff4dd7-kube-api-access-q7rcq\") pod \"managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn\" (UID: \"562a037a-a3a5-4b15-8991-f17d95ff4dd7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"
Jul 08 01:43:28.156346 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648f4790-58a1-4562-bcd3-21ff7a19f42b-tmp\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.156346 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.156346 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e15e1dd8-bc81-408a-80eb-465c0c466432-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-75cq8\" (UID: \"e15e1dd8-bc81-408a-80eb-465c0c466432\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"
Jul 08 01:43:28.156346 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-hub\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.156346 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/562a037a-a3a5-4b15-8991-f17d95ff4dd7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn\" (UID: \"562a037a-a3a5-4b15-8991-f17d95ff4dd7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"
Jul 08 01:43:28.156346 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2444472e-0027-4ba9-99dc-bc7fa65b8904-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.156346 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txr4m\" (UniqueName: \"kubernetes.io/projected/648f4790-58a1-4562-bcd3-21ff7a19f42b-kube-api-access-txr4m\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.159008 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd8pv\" (UniqueName: \"kubernetes.io/projected/2444472e-0027-4ba9-99dc-bc7fa65b8904-kube-api-access-kd8pv\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.159008 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-ca\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.159008 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.159008 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.156432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/648f4790-58a1-4562-bcd3-21ff7a19f42b-klusterlet-config\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.159008 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.157821    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/648f4790-58a1-4562-bcd3-21ff7a19f42b-tmp\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.159870 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.159568    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2444472e-0027-4ba9-99dc-bc7fa65b8904-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.159870 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.159568    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e15e1dd8-bc81-408a-80eb-465c0c466432-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-75cq8\" (UID: \"e15e1dd8-bc81-408a-80eb-465c0c466432\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"
Jul 08 01:43:28.162684 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.162391    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/648f4790-58a1-4562-bcd3-21ff7a19f42b-klusterlet-config\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.162811 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.162731    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/562a037a-a3a5-4b15-8991-f17d95ff4dd7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn\" (UID: \"562a037a-a3a5-4b15-8991-f17d95ff4dd7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"
Jul 08 01:43:28.163321 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.163270    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-hub\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.163321 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.163307    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.163561 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.163536    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e15e1dd8-bc81-408a-80eb-465c0c466432-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-75cq8\" (UID: \"e15e1dd8-bc81-408a-80eb-465c0c466432\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"
Jul 08 01:43:28.164358 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.164314    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.165788 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.165690    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2444472e-0027-4ba9-99dc-bc7fa65b8904-ca\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.166036 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.165980    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:28.173848 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.173824    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txr4m\" (UniqueName: \"kubernetes.io/projected/648f4790-58a1-4562-bcd3-21ff7a19f42b-kube-api-access-txr4m\") pod \"klusterlet-addon-workmgr-77c6b44cbf-cfrw7\" (UID: \"648f4790-58a1-4562-bcd3-21ff7a19f42b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.174857 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.174814    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd8pv\" (UniqueName: \"kubernetes.io/projected/2444472e-0027-4ba9-99dc-bc7fa65b8904-kube-api-access-kd8pv\") pod \"cluster-proxy-proxy-agent-6df4668549-rmggw\" (UID: \"2444472e-0027-4ba9-99dc-bc7fa65b8904\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.174990 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.174909    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7rcq\" (UniqueName: \"kubernetes.io/projected/562a037a-a3a5-4b15-8991-f17d95ff4dd7-kube-api-access-q7rcq\") pod \"managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn\" (UID: \"562a037a-a3a5-4b15-8991-f17d95ff4dd7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"
Jul 08 01:43:28.257073 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.256931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdpdl\" (UniqueName: \"kubernetes.io/projected/e9408cdf-e7b9-46b8-958d-8959a4c8c9db-kube-api-access-zdpdl\") pod \"downloads-685bfb5f64-8r8ct\" (UID: \"e9408cdf-e7b9-46b8-958d-8959a4c8c9db\") " pod="openshift-console/downloads-685bfb5f64-8r8ct"
Jul 08 01:43:28.264788 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.264757    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:28.280330 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.280305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"
Jul 08 01:43:28.301686 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.301658    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:28.319916 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.319673    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"
Jul 08 01:43:28.327043 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.326965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"
Jul 08 01:43:28.357973 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.357944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdpdl\" (UniqueName: \"kubernetes.io/projected/e9408cdf-e7b9-46b8-958d-8959a4c8c9db-kube-api-access-zdpdl\") pod \"downloads-685bfb5f64-8r8ct\" (UID: \"e9408cdf-e7b9-46b8-958d-8959a4c8c9db\") " pod="openshift-console/downloads-685bfb5f64-8r8ct"
Jul 08 01:43:28.376037 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.375977    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdpdl\" (UniqueName: \"kubernetes.io/projected/e9408cdf-e7b9-46b8-958d-8959a4c8c9db-kube-api-access-zdpdl\") pod \"downloads-685bfb5f64-8r8ct\" (UID: \"e9408cdf-e7b9-46b8-958d-8959a4c8c9db\") " pod="openshift-console/downloads-685bfb5f64-8r8ct"
Jul 08 01:43:28.452540 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.452343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-8r8ct"
Jul 08 01:43:28.467116 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.466644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:28.546686 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.546527    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-75cq8"]
Jul 08 01:43:28.552395 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.552298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:28.575434 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.574470    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw"]
Jul 08 01:43:28.575434 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.575334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd" event={"ID":"bb9ca78d-379e-41fb-baed-0446060babb9","Type":"ContainerStarted","Data":"93b13ae1a039bfc846846fd9dae468c37d92ee65123839701f3c271e6b66135e"}
Jul 08 01:43:28.582892 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.582850    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d948f6b97-b56nd" event={"ID":"f2138832-8c0b-47ac-a7ea-2ac8ee294447","Type":"ContainerStarted","Data":"5796f1423047487c76c2afeead0e0f9c12d86b71501ababc6b92a73827236345"}
Jul 08 01:43:28.587005 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.586462    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d948f6b97-b56nd" event={"ID":"f2138832-8c0b-47ac-a7ea-2ac8ee294447","Type":"ContainerStarted","Data":"7fed60809a4ee6f91ca18c68b7e3e034af77db9e936d28a6fb5ac67240f8d979"}
Jul 08 01:43:28.595179 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.592737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8" event={"ID":"e15e1dd8-bc81-408a-80eb-465c0c466432","Type":"ContainerStarted","Data":"f8d928c787364c5172d5f3fb8b6456d33226f5e60568834a86a45e8a76cbd285"}
Jul 08 01:43:28.603684 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.603555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"]
Jul 08 01:43:28.615233 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.608523    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d948f6b97-b56nd" podStartSLOduration=33.608504118 podStartE2EDuration="33.608504118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:28.605555937 +0000 UTC m=+70.971389659" watchObservedRunningTime="2026-07-08 01:43:28.608504118 +0000 UTC m=+70.974337840"
Jul 08 01:43:28.664067 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.664013    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn"]
Jul 08 01:43:28.692823 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.691696    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-8r8ct"]
Jul 08 01:43:28.763213 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.763171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:28.766739 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:28.766478    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:29.002909 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:29.002873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:29.086329 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:29.086297    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:29.415490 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:29.415458    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:29.516505 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:29.516453    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:29.596804 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:29.596618    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:29.597990 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:29.597961    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d948f6b97-b56nd"
Jul 08 01:43:30.093790 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:30.093680    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648f4790_58a1_4562_bcd3_21ff7a19f42b.slice/crio-d245784ebfcd2d51c86e9d1cb1668f732cf8a69585685601f5a7f62883a4a263 WatchSource:0}: Error finding container d245784ebfcd2d51c86e9d1cb1668f732cf8a69585685601f5a7f62883a4a263: Status 404 returned error can't find the container with id d245784ebfcd2d51c86e9d1cb1668f732cf8a69585685601f5a7f62883a4a263
Jul 08 01:43:30.095026 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:30.094986    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod562a037a_a3a5_4b15_8991_f17d95ff4dd7.slice/crio-bbe0c8179efdfd31f83c39ab2398546b4c0ece9a99c6bd16613516d143b3203b WatchSource:0}: Error finding container bbe0c8179efdfd31f83c39ab2398546b4c0ece9a99c6bd16613516d143b3203b: Status 404 returned error can't find the container with id bbe0c8179efdfd31f83c39ab2398546b4c0ece9a99c6bd16613516d143b3203b
Jul 08 01:43:30.201342 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:30.201291    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:30.260804 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:30.260772    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:30.603133 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:30.603082    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7" event={"ID":"648f4790-58a1-4562-bcd3-21ff7a19f42b","Type":"ContainerStarted","Data":"d245784ebfcd2d51c86e9d1cb1668f732cf8a69585685601f5a7f62883a4a263"}
Jul 08 01:43:30.604445 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:30.604414    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn" event={"ID":"562a037a-a3a5-4b15-8991-f17d95ff4dd7","Type":"ContainerStarted","Data":"bbe0c8179efdfd31f83c39ab2398546b4c0ece9a99c6bd16613516d143b3203b"}
Jul 08 01:43:30.605986 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:30.605955    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:30.707112 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:30.707083    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:30.808031 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:30.807999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:30.860459 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:30.860336    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:32.105560 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:32.105525    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2444472e_0027_4ba9_99dc_bc7fa65b8904.slice/crio-261b918cf21c4880a51b9e0f274992d6979f486ee94143d31abd0d5b1825e4e2 WatchSource:0}: Error finding container 261b918cf21c4880a51b9e0f274992d6979f486ee94143d31abd0d5b1825e4e2: Status 404 returned error can't find the container with id 261b918cf21c4880a51b9e0f274992d6979f486ee94143d31abd0d5b1825e4e2
Jul 08 01:43:32.555747 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:32.555690    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:32.617928 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:32.617894    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw" event={"ID":"2444472e-0027-4ba9-99dc-bc7fa65b8904","Type":"ContainerStarted","Data":"261b918cf21c4880a51b9e0f274992d6979f486ee94143d31abd0d5b1825e4e2"}
Jul 08 01:43:32.637951 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:32.637921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:32.651722 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:32.651672    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9408cdf_e7b9_46b8_958d_8959a4c8c9db.slice/crio-30bf3bc2f813444c91a50ea810b3ed85063c5a05b709c383de7f74ac26118059 WatchSource:0}: Error finding container 30bf3bc2f813444c91a50ea810b3ed85063c5a05b709c383de7f74ac26118059: Status 404 returned error can't find the container with id 30bf3bc2f813444c91a50ea810b3ed85063c5a05b709c383de7f74ac26118059
Jul 08 01:43:33.622282 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:33.622208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-8r8ct" event={"ID":"e9408cdf-e7b9-46b8-958d-8959a4c8c9db","Type":"ContainerStarted","Data":"30bf3bc2f813444c91a50ea810b3ed85063c5a05b709c383de7f74ac26118059"}
Jul 08 01:43:33.901594 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:33.901522    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:33.969927 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:33.969892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:34.631764 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.631728    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:34.634061 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.633233    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cmvbh" event={"ID":"7833b36c-c519-4737-8bf8-e63feee36e20","Type":"ContainerStarted","Data":"f0eddd377626ad206e02cf766f0457bd20a17193a89d4a39f3b4d3904d28c59c"}
Jul 08 01:43:34.640351 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.639013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd" event={"ID":"bb9ca78d-379e-41fb-baed-0446060babb9","Type":"ContainerStarted","Data":"f344509485a0a1053c5116fa22cd22c089f88504b0809171de86ad659251b1a1"}
Jul 08 01:43:34.643747 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.643159    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmnhz" event={"ID":"5470ee1b-e719-4a61-b2aa-b5efb6f8942d","Type":"ContainerStarted","Data":"141ae3d2925400cf135c4dfffa83b0b96563ed666d769baff9ca64128263589c"}
Jul 08 01:43:34.643747 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.643206    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmnhz" event={"ID":"5470ee1b-e719-4a61-b2aa-b5efb6f8942d","Type":"ContainerStarted","Data":"7699cc51187e9cec22114f11e9eb5052dff5fbca32a220ba1805b6519e202762"}
Jul 08 01:43:34.643747 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.643674    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:43:34.648131 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.648091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8" event={"ID":"e15e1dd8-bc81-408a-80eb-465c0c466432","Type":"ContainerStarted","Data":"eec54e9900132804af670dfe2046bfafdf65080339006a6029075134a4433bc3"}
Jul 08 01:43:34.653481 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.653454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4kg58" event={"ID":"438cf5d5-0436-422d-9424-e58bb52ac313","Type":"ContainerStarted","Data":"c64b172d4612171e43c68248e8ef8a4c772ca724bf52046f922f7e41cf739898"}
Jul 08 01:43:34.653900 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.653600    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cmvbh" podStartSLOduration=68.501799464 podStartE2EDuration="1m16.653582792s" totalImagesPullingTime="8.151783328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:34.652513601 +0000 UTC m=+77.018347321" watchObservedRunningTime="2026-07-08 01:43:34.653582792 +0000 UTC m=+77.019416514"
Jul 08 01:43:34.672859 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.672805    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmnhz" podStartSLOduration=33.958238987 podStartE2EDuration="40.672785792s" totalImagesPullingTime="6.714546805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:34.671243022 +0000 UTC m=+77.037076748" watchObservedRunningTime="2026-07-08 01:43:34.672785792 +0000 UTC m=+77.038619514"
Jul 08 01:43:34.720053 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.718954    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-75cq8" podStartSLOduration=2.244153981 podStartE2EDuration="7.718934351s" totalImagesPullingTime="5.47478037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:34.717626666 +0000 UTC m=+77.083460389" watchObservedRunningTime="2026-07-08 01:43:34.718934351 +0000 UTC m=+77.084768074"
Jul 08 01:43:34.720053 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.719126    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c7skd" podStartSLOduration=33.625850138 podStartE2EDuration="39.719115623s" totalImagesPullingTime="6.093265485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:34.699610185 +0000 UTC m=+77.065443908" watchObservedRunningTime="2026-07-08 01:43:34.719115623 +0000 UTC m=+77.084949347"
Jul 08 01:43:34.732529 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.732463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:34.751009 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.750956    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4kg58" podStartSLOduration=17.678984485 podStartE2EDuration="29.75093282s" totalImagesPullingTime="12.071948335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:43:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:34.749595399 +0000 UTC m=+77.115429122" watchObservedRunningTime="2026-07-08 01:43:34.75093282 +0000 UTC m=+77.116766560"
Jul 08 01:43:34.807948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.807850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:34.901745 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:34.901626    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:35.001315 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:35.001150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:35.757492 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:35.757361    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:36.869850 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:36.869814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:37.675810 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:37.675720    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn" event={"ID":"562a037a-a3a5-4b15-8991-f17d95ff4dd7","Type":"ContainerStarted","Data":"4e0a3f7f09b2d1c0d6969f90e383a6ab1b7395e9cbd3b18c031dc8366ddbf1dc"}
Jul 08 01:43:37.696656 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:37.696599    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8fc7c7b-b7rgn" podStartSLOduration=3.550346361 podStartE2EDuration="10.696577908s" totalImagesPullingTime="7.146231547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:37.696290626 +0000 UTC m=+80.062124349" watchObservedRunningTime="2026-07-08 01:43:37.696577908 +0000 UTC m=+80.062411632"
Jul 08 01:43:38.866989 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:38.866949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:38.968266 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:38.968223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:39.874241 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:39.874210    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:39.928418 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:39.928386    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:43.262120 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.262069    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:43.313902 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.313868    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:43.707419 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.707368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7" event={"ID":"648f4790-58a1-4562-bcd3-21ff7a19f42b","Type":"ContainerStarted","Data":"4a0c60fb7e539218c64ff019eb88fed5f10a4e2f4fdb89e64ec9a853cb2c851c"}
Jul 08 01:43:43.707604 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.707436    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:43.709581 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.709558    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7"
Jul 08 01:43:43.709867 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.709844    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw" event={"ID":"2444472e-0027-4ba9-99dc-bc7fa65b8904","Type":"ContainerStarted","Data":"20e8a3d4aadab41b8bf090833e0b7cf3637802bca0b2e609ca5f7971e89c8c3b"}
Jul 08 01:43:43.709976 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.709879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw" event={"ID":"2444472e-0027-4ba9-99dc-bc7fa65b8904","Type":"ContainerStarted","Data":"802ac1e4b32b97fb551ad56c38671ca26e2f32ae51f5adac84a277642411214e"}
Jul 08 01:43:43.709976 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.709897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw" event={"ID":"2444472e-0027-4ba9-99dc-bc7fa65b8904","Type":"ContainerStarted","Data":"93a492295d37e80d17fbd433e3e0bb5cd90df573b0d9c7fc898b187b8fb25bd8"}
Jul 08 01:43:43.726548 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.726498    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77c6b44cbf-cfrw7" podStartSLOduration=4.107904841 podStartE2EDuration="16.726478928s" totalImagesPullingTime="12.618574087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:43.724536447 +0000 UTC m=+86.090370169" watchObservedRunningTime="2026-07-08 01:43:43.726478928 +0000 UTC m=+86.092312651"
Jul 08 01:43:43.745689 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.745652    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df4668549-rmggw" podStartSLOduration=6.133855485 podStartE2EDuration="16.745639024s" totalImagesPullingTime="10.611783539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:43.744958695 +0000 UTC m=+86.110792418" watchObservedRunningTime="2026-07-08 01:43:43.745639024 +0000 UTC m=+86.111472748"
Jul 08 01:43:43.775034 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.775002    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:43.839275 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:43.839236    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:44.293197 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:44.293159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:44.394504 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:44.394464    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:44.468915 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:44.468879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:45.305842 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:45.305811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:45.672498 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:45.672412    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmnhz"
Jul 08 01:43:46.007039 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:46.007001    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:46.107645 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:46.103988    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:46.409429 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:46.409352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:47.023349 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:47.023313    2582 patch_prober.go:28] interesting pod/image-registry-5d75f7867c-2qj2v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 01:43:47.023522 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:47.023377    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v" podUID="692a83fa-c903-4b0e-90c5-55c01a4847b0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 01:43:47.257568 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:47.257519    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:47.314194 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:47.314105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:47.933053 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:47.932984    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:48.134758 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.134690    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:48.188853 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.187129    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ptfh5"]
Jul 08 01:43:48.191926 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.191898    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.206242 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.205959    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-658t5\""
Jul 08 01:43:48.206242 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.205989    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 01:43:48.206681 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.206659    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 01:43:48.207902 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.207881    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 01:43:48.208140 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.208125    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 01:43:48.227567 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/805c1ba3-13d7-4462-8638-77b691002ba7-metrics-client-ca\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.227694 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rfnr\" (UniqueName: \"kubernetes.io/projected/805c1ba3-13d7-4462-8638-77b691002ba7-kube-api-access-6rfnr\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.227694 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-wtmp\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.227694 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.227922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-sys\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.227922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-tls\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.227922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-textfile\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.227922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.228123 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.227938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-root\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.259180 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.259149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:48.328649 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-sys\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.328649 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-tls\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.328649 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-textfile\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.328649 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.328649 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-root\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.329041 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/805c1ba3-13d7-4462-8638-77b691002ba7-metrics-client-ca\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.329041 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rfnr\" (UniqueName: \"kubernetes.io/projected/805c1ba3-13d7-4462-8638-77b691002ba7-kube-api-access-6rfnr\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.329041 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-wtmp\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.329041 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.328758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.329826 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.329417    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.329826 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.329496    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-sys\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.329826 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:48.329618    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 01:43:48.329826 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:43:48.329685    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-tls podName:805c1ba3-13d7-4462-8638-77b691002ba7 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:48.829663532 +0000 UTC m=+91.195497235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-tls") pod "node-exporter-ptfh5" (UID: "805c1ba3-13d7-4462-8638-77b691002ba7") : secret "node-exporter-tls" not found
Jul 08 01:43:48.330369 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.330188    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-textfile\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.331296 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.330668    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-wtmp\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.331296 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.330752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/805c1ba3-13d7-4462-8638-77b691002ba7-root\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.331296 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.331237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/805c1ba3-13d7-4462-8638-77b691002ba7-metrics-client-ca\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.333390 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.333360    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.339574 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.339550    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rfnr\" (UniqueName: \"kubernetes.io/projected/805c1ba3-13d7-4462-8638-77b691002ba7-kube-api-access-6rfnr\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.443771 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.443012    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:48.542490 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.542428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:48.652557 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.652512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:48.753554 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.753474    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:48.834082 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.834047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-tls\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.836863 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.836833    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/805c1ba3-13d7-4462-8638-77b691002ba7-node-exporter-tls\") pod \"node-exporter-ptfh5\" (UID: \"805c1ba3-13d7-4462-8638-77b691002ba7\") " pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:48.874767 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:48.874733    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:49.107454 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:49.107367    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ptfh5"
Jul 08 01:43:49.225726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:49.225675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:49.295219 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:49.295184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:49.361690 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:49.361596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:49.541052 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:49.541013    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:49.602297 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:49.602267    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:43:50.220617 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:50.220576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:50.321164 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:50.321127    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:50.458901 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:50.458861    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:50.559637 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:50.559453    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:50.662988 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:50.662944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:50.760174 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:50.760143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:51.080627 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:51.080593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:51.184974 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:51.184929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:51.296470 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:51.296435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:51.463715 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:51.463667    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:52.948455 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:52.948422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:53.048329 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:53.048288    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:53.470563 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:53.470529    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:54.365130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:54.365097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:54.446569 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:54.446538    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d75f7867c-2qj2v"]
Jul 08 01:43:54.534104 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:54.534070    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:54.634448 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:54.634366    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:54.734281 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:54.734237    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:54.819155 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:54.819113    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:55.329999 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:43:55.329964    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805c1ba3_13d7_4462_8638_77b691002ba7.slice/crio-0fc5d55524ca70fbe79b54551cbce4fe9cdfdfc29de881d50311161f44f16907 WatchSource:0}: Error finding container 0fc5d55524ca70fbe79b54551cbce4fe9cdfdfc29de881d50311161f44f16907: Status 404 returned error can't find the container with id 0fc5d55524ca70fbe79b54551cbce4fe9cdfdfc29de881d50311161f44f16907
Jul 08 01:43:55.549564 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:55.549528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:55.649390 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:55.649316    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:55.787174 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:55.787133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptfh5" event={"ID":"805c1ba3-13d7-4462-8638-77b691002ba7","Type":"ContainerStarted","Data":"0fc5d55524ca70fbe79b54551cbce4fe9cdfdfc29de881d50311161f44f16907"}
Jul 08 01:43:56.105648 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:56.105605    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:56.207855 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:56.207822    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:56.794021 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:56.793985    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-8r8ct" event={"ID":"e9408cdf-e7b9-46b8-958d-8959a4c8c9db","Type":"ContainerStarted","Data":"dc77c3052a27ca94cca68a94c83ca87bb4401c667efd44f2cdcae11a1eee45af"}
Jul 08 01:43:56.794481 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:56.794221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-8r8ct"
Jul 08 01:43:56.813439 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:56.813411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-8r8ct"
Jul 08 01:43:56.814338 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:56.814268    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-8r8ct" podStartSLOduration=6.289571569 podStartE2EDuration="28.814253098s" totalImagesPullingTime="22.524681529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:56.811205738 +0000 UTC m=+99.177039462" watchObservedRunningTime="2026-07-08 01:43:56.814253098 +0000 UTC m=+99.180086838"
Jul 08 01:43:56.880370 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:56.880337    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:56.976728 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:56.976628    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:57.562747 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:57.562694    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-95trb"
Jul 08 01:43:57.633007 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:57.632967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:57.734272 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:57.734237    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:57.801242 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:57.801206    2582 generic.go:356] "Generic (PLEG): container finished" podID="805c1ba3-13d7-4462-8638-77b691002ba7" containerID="a36e7c506bdc025728ebebc8ef82e894be3d75b33cbeaf0cd775c051ca3b4426" exitCode=0
Jul 08 01:43:57.801726 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:57.801298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptfh5" event={"ID":"805c1ba3-13d7-4462-8638-77b691002ba7","Type":"ContainerDied","Data":"a36e7c506bdc025728ebebc8ef82e894be3d75b33cbeaf0cd775c051ca3b4426"}
Jul 08 01:43:58.398592 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:58.398552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:58.474406 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:58.474368    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:58.808252 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:58.808215    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptfh5" event={"ID":"805c1ba3-13d7-4462-8638-77b691002ba7","Type":"ContainerStarted","Data":"956d8ef1f743b48c58c52eaad2c955348c98c5abc80ade0845826407e2df5a25"}
Jul 08 01:43:58.808754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:58.808277    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptfh5" event={"ID":"805c1ba3-13d7-4462-8638-77b691002ba7","Type":"ContainerStarted","Data":"a8877f7c03ac379464c905251660fbc39b2a3732457e29af7f9098b589df63f4"}
Jul 08 01:43:58.832719 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:58.832645    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ptfh5" podStartSLOduration=9.366956584 podStartE2EDuration="10.832626919s" totalImagesPullingTime="1.366100411s" totalInitContainerRuntime="99.569924ms" isStatefulPod=true podCreationTimestamp="2026-07-08 01:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:58.830827113 +0000 UTC m=+101.196660837" watchObservedRunningTime="2026-07-08 01:43:58.832626919 +0000 UTC m=+101.198460641"
Jul 08 01:43:59.122176 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:59.122097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:43:59.181388 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:43:59.181348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:00.835138 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:00.835085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:00.947658 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:00.947612    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:03.913286 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:03.913252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:04.011859 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:04.011816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:04.570328 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:04.570289    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:04.670543 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:04.670504    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:04.771460 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:04.771423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:06.288330 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:06.288302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:06.371683 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:06.371643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:07.409624 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:07.409584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:07.515045 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:07.515014    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:07.594967 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:07.594933    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:15.804121 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:15.804090    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:15.875634 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:15.875600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:15.882007 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:15.881981    2582 generic.go:356] "Generic (PLEG): container finished" podID="949f7197-dd85-4a7e-9e26-632696936f4c" containerID="8b02d4cc3497beb03bee8b5fc1d991e4689b19581a8cd565e80cbb699bda2c34" exitCode=0
Jul 08 01:44:15.882148 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:15.882051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485" event={"ID":"949f7197-dd85-4a7e-9e26-632696936f4c","Type":"ContainerDied","Data":"8b02d4cc3497beb03bee8b5fc1d991e4689b19581a8cd565e80cbb699bda2c34"}
Jul 08 01:44:15.882371 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:15.882357    2582 scope.go:117] "RemoveContainer" containerID="8b02d4cc3497beb03bee8b5fc1d991e4689b19581a8cd565e80cbb699bda2c34"
Jul 08 01:44:16.888445 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:16.888405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-dq485" event={"ID":"949f7197-dd85-4a7e-9e26-632696936f4c","Type":"ContainerStarted","Data":"8f93e3ebcc6a8d6a7d378c44f0fd922c349b6f7a753ca1137a3f81f642d02668"}
Jul 08 01:44:19.470373 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.470325    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v" podUID="692a83fa-c903-4b0e-90c5-55c01a4847b0" containerName="registry" containerID="cri-o://d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb" gracePeriod=30
Jul 08 01:44:19.596947 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.596909    2582 patch_prober.go:28] interesting pod/image-registry-5d75f7867c-2qj2v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body=
Jul 08 01:44:19.597265 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.596969    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v" podUID="692a83fa-c903-4b0e-90c5-55c01a4847b0" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused"
Jul 08 01:44:19.748501 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.748433    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:44:19.811128 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811093    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-certificates\") pod \"692a83fa-c903-4b0e-90c5-55c01a4847b0\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") "
Jul 08 01:44:19.811128 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811129    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j9r2\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-kube-api-access-7j9r2\") pod \"692a83fa-c903-4b0e-90c5-55c01a4847b0\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") "
Jul 08 01:44:19.811369 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811154    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-image-registry-private-configuration\") pod \"692a83fa-c903-4b0e-90c5-55c01a4847b0\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") "
Jul 08 01:44:19.811369 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811177    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/692a83fa-c903-4b0e-90c5-55c01a4847b0-ca-trust-extracted\") pod \"692a83fa-c903-4b0e-90c5-55c01a4847b0\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") "
Jul 08 01:44:19.811369 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811213    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-installation-pull-secrets\") pod \"692a83fa-c903-4b0e-90c5-55c01a4847b0\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") "
Jul 08 01:44:19.811369 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811248    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") pod \"692a83fa-c903-4b0e-90c5-55c01a4847b0\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") "
Jul 08 01:44:19.811369 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811273    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-trusted-ca\") pod \"692a83fa-c903-4b0e-90c5-55c01a4847b0\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") "
Jul 08 01:44:19.811369 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811311    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-bound-sa-token\") pod \"692a83fa-c903-4b0e-90c5-55c01a4847b0\" (UID: \"692a83fa-c903-4b0e-90c5-55c01a4847b0\") "
Jul 08 01:44:19.811687 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.811568    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "692a83fa-c903-4b0e-90c5-55c01a4847b0" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 01:44:19.812104 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.812076    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "692a83fa-c903-4b0e-90c5-55c01a4847b0" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 01:44:19.813980 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.813930    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-kube-api-access-7j9r2" (OuterVolumeSpecName: "kube-api-access-7j9r2") pod "692a83fa-c903-4b0e-90c5-55c01a4847b0" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0"). InnerVolumeSpecName "kube-api-access-7j9r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:44:19.813980 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.813961    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "692a83fa-c903-4b0e-90c5-55c01a4847b0" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 01:44:19.814155 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.814050    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "692a83fa-c903-4b0e-90c5-55c01a4847b0" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:44:19.814155 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.814093    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "692a83fa-c903-4b0e-90c5-55c01a4847b0" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 01:44:19.814155 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.814108    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "692a83fa-c903-4b0e-90c5-55c01a4847b0" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:44:19.822129 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.822097    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692a83fa-c903-4b0e-90c5-55c01a4847b0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "692a83fa-c903-4b0e-90c5-55c01a4847b0" (UID: "692a83fa-c903-4b0e-90c5-55c01a4847b0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 01:44:19.901105 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.901075    2582 generic.go:356] "Generic (PLEG): container finished" podID="692a83fa-c903-4b0e-90c5-55c01a4847b0" containerID="d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb" exitCode=0
Jul 08 01:44:19.901260 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.901129    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v"
Jul 08 01:44:19.901260 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.901158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v" event={"ID":"692a83fa-c903-4b0e-90c5-55c01a4847b0","Type":"ContainerDied","Data":"d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb"}
Jul 08 01:44:19.901260 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.901231    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d75f7867c-2qj2v" event={"ID":"692a83fa-c903-4b0e-90c5-55c01a4847b0","Type":"ContainerDied","Data":"e41d48590e3bbc8cd0bac3f7d127a243fbbaf23bc0e86961f6235e918d28acd0"}
Jul 08 01:44:19.901260 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.901252    2582 scope.go:117] "RemoveContainer" containerID="d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb"
Jul 08 01:44:19.910205 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.910190    2582 scope.go:117] "RemoveContainer" containerID="d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb"
Jul 08 01:44:19.910487 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:44:19.910467    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb\": container with ID starting with d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb not found: ID does not exist" containerID="d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb"
Jul 08 01:44:19.910561 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.910497    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb"} err="failed to get container status \"d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb\": rpc error: code = NotFound desc = could not find container \"d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb\": container with ID starting with d9c0166427faa6d573cc243f992d8eabb6894b31c7973e7bbeafe16bbb98acfb not found: ID does not exist"
Jul 08 01:44:19.912786 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.912768    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-image-registry-private-configuration\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:44:19.912887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.912789    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/692a83fa-c903-4b0e-90c5-55c01a4847b0-ca-trust-extracted\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:44:19.912887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.912802    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/692a83fa-c903-4b0e-90c5-55c01a4847b0-installation-pull-secrets\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:44:19.912887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.912816    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-tls\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:44:19.912887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.912828    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-trusted-ca\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:44:19.912887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.912840    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-bound-sa-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:44:19.912887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.912852    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/692a83fa-c903-4b0e-90c5-55c01a4847b0-registry-certificates\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:44:19.912887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.912865    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j9r2\" (UniqueName: \"kubernetes.io/projected/692a83fa-c903-4b0e-90c5-55c01a4847b0-kube-api-access-7j9r2\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:44:19.922324 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.922304    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d75f7867c-2qj2v"]
Jul 08 01:44:19.926004 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:19.925985    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d75f7867c-2qj2v"]
Jul 08 01:44:20.164478 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:20.164395    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="692a83fa-c903-4b0e-90c5-55c01a4847b0" path="/var/lib/kubelet/pods/692a83fa-c903-4b0e-90c5-55c01a4847b0/volumes"
Jul 08 01:44:25.926430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:25.926392    2582 generic.go:356] "Generic (PLEG): container finished" podID="a01783bc-0824-4f3c-a7cf-ccc633c5a55b" containerID="6d1fe09a611503eb673e9e94815838b06bda38ad44b552d08a4d2cdec3366062" exitCode=0
Jul 08 01:44:25.926889 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:25.926449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv" event={"ID":"a01783bc-0824-4f3c-a7cf-ccc633c5a55b","Type":"ContainerDied","Data":"6d1fe09a611503eb673e9e94815838b06bda38ad44b552d08a4d2cdec3366062"}
Jul 08 01:44:25.926889 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:25.926815    2582 scope.go:117] "RemoveContainer" containerID="6d1fe09a611503eb673e9e94815838b06bda38ad44b552d08a4d2cdec3366062"
Jul 08 01:44:26.931987 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:26.931952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-j2cdv" event={"ID":"a01783bc-0824-4f3c-a7cf-ccc633c5a55b","Type":"ContainerStarted","Data":"a0ba2ac68949fdecdef30032d0ec082eddf435f2a7d6d84759459d9284adf433"}
Jul 08 01:44:35.966068 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:35.966026    2582 generic.go:356] "Generic (PLEG): container finished" podID="e6436ac3-aade-42e2-9740-cc73adb66b91" containerID="2e4e39a15c72a3b3dae438168bb0f79c5307101324f64378d2567aa729378151" exitCode=0
Jul 08 01:44:35.966565 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:35.966083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77" event={"ID":"e6436ac3-aade-42e2-9740-cc73adb66b91","Type":"ContainerDied","Data":"2e4e39a15c72a3b3dae438168bb0f79c5307101324f64378d2567aa729378151"}
Jul 08 01:44:35.966565 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:35.966471    2582 scope.go:117] "RemoveContainer" containerID="2e4e39a15c72a3b3dae438168bb0f79c5307101324f64378d2567aa729378151"
Jul 08 01:44:36.972153 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:36.972105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-85w77" event={"ID":"e6436ac3-aade-42e2-9740-cc73adb66b91","Type":"ContainerStarted","Data":"966089d8232d036e39339d68f5d76869194e38557d7eb6cf8d82048ed281b04c"}
Jul 08 01:44:40.643170 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:40.643127    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:44:40.701534 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:44:40.701430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:00.179230 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:00.179174    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:07.350548 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:07.350502    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:07.451531 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:07.451496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:16.528134 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:16.528041    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:27.865347 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:27.865312    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:27.962922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:27.962889    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:28.015392 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:28.015362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:47.107323 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:47.107258    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:57.079473 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:57.079433    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:45:57.134880 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:45:57.134842    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:22.570846 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:22.570813    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:22.639519 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:22.639480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:24.667570 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:24.667538    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:24.721326 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:24.721296    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:34.521269 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:34.521238    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:34.622545 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:34.622499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:45.813419 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:45.813335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:45.913977 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:45.913945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:45.975588 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:45.975551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:54.999514 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:54.999479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:46:55.051396 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:46:55.051367    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:47:04.926400 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:47:04.926357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:47:06.174232 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:47:06.174199    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:47:06.301336 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:47:06.301302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:47:18.063143 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:47:18.063112    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 01:47:18.069849 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:47:18.069827    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 01:47:18.074271 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:47:18.074245    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 01:47:44.020979 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:47:44.020938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:47:44.106773 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:47:44.106742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:11.066275 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:11.066194    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:12.443796 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:12.443758    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:14.676051 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:14.676012    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:14.775931 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:14.775896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:15.848266 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:15.848230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:15.958932 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:15.958900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:16.903414 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:16.903383    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:17.011341 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:17.011308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:19.091721 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:19.091673    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:19.531947 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:19.531911    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:27.110002 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:27.109963    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:28.754740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:28.754690    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:28.913742 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:28.913691    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:35.346574 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:35.346535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:35.446198 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:35.446167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:37.365881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:37.365850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:39.690875 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:39.690844    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:39.789903 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:39.789869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:49.329790 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:49.329750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:49.435434 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:49.435401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:49.996800 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:49.996762    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.154876 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.154841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.257207 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.257125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.310777 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.310742    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"]
Jul 08 01:48:50.311044 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.311031    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692a83fa-c903-4b0e-90c5-55c01a4847b0" containerName="registry"
Jul 08 01:48:50.311097 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.311045    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="692a83fa-c903-4b0e-90c5-55c01a4847b0" containerName="registry"
Jul 08 01:48:50.311134 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.311116    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="692a83fa-c903-4b0e-90c5-55c01a4847b0" containerName="registry"
Jul 08 01:48:50.313175 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.313155    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.318000 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.317971    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 01:48:50.318130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.318066    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 01:48:50.318130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.318085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 01:48:50.318285 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.318267    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 01:48:50.318340 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.318277    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2dr79\""
Jul 08 01:48:50.344025 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.343995    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"]
Jul 08 01:48:50.431265 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.431230    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.506186 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.506143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.506186 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.506184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.506382 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.506210    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8rdp\" (UniqueName: \"kubernetes.io/projected/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-kube-api-access-p8rdp\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.506382 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.506285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-manifests\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.506382 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.506327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-tmp\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.531289 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.531206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.607299 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.607263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.607299 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.607299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.607605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.607322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8rdp\" (UniqueName: \"kubernetes.io/projected/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-kube-api-access-p8rdp\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.607605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.607363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-manifests\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.607605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.607386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-tmp\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.607918 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.607890    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-manifests\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.609655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.609625    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-tmp\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.609899 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.609877    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.609973 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.609958    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.616396 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.616376    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8rdp\" (UniqueName: \"kubernetes.io/projected/1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0-kube-api-access-p8rdp\") pod \"opendatahub-operator-controller-manager-8bbd955f5-8vk9k\" (UID: \"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0\") " pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.625267 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.625244    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:50.627482 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.627301    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.742117 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.742086    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.776444 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.776415    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"]
Jul 08 01:48:50.780478 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:48:50.780452    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b27e55a_5e4c_4c66_a3f7_96c84cdd44b0.slice/crio-e0d847175c3cf31c28cf0cd9222586ea59dec13f724a0af0ba89bdb64f44a1a9 WatchSource:0}: Error finding container e0d847175c3cf31c28cf0cd9222586ea59dec13f724a0af0ba89bdb64f44a1a9: Status 404 returned error can't find the container with id e0d847175c3cf31c28cf0cd9222586ea59dec13f724a0af0ba89bdb64f44a1a9
Jul 08 01:48:50.782198 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.782152    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 01:48:50.834662 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.834630    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.950543 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.950495    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:50.951125 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:50.951102    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k" event={"ID":"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0","Type":"ContainerStarted","Data":"e0d847175c3cf31c28cf0cd9222586ea59dec13f724a0af0ba89bdb64f44a1a9"}
Jul 08 01:48:51.053311 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:51.053234    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:53.968285 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:53.968250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k" event={"ID":"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0","Type":"ContainerStarted","Data":"9bfeb7c9d0d5ffc5eb20defc2b48dd43869a68ccf3dd24045d9cc87412cb3798"}
Jul 08 01:48:54.973729 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:54.973677    2582 generic.go:356] "Generic (PLEG): container finished" podID="1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0" containerID="9bfeb7c9d0d5ffc5eb20defc2b48dd43869a68ccf3dd24045d9cc87412cb3798" exitCode=0
Jul 08 01:48:54.974151 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:54.973774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k" event={"ID":"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0","Type":"ContainerDied","Data":"9bfeb7c9d0d5ffc5eb20defc2b48dd43869a68ccf3dd24045d9cc87412cb3798"}
Jul 08 01:48:55.627174 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:55.627080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:55.748380 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:55.748347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:48:55.980621 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:55.980584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k" event={"ID":"1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0","Type":"ContainerStarted","Data":"62bb79ca7643961d096b12f3a735110c1bfe2438a50d94ffc5d960d8925f5aaa"}
Jul 08 01:48:55.981254 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:55.980741    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:48:56.007669 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:48:56.007611    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k" podStartSLOduration=1.714798224 podStartE2EDuration="6.007596484s" totalImagesPullingTime="3.195788828s" totalInitContainerRuntime="1.097009432s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:48:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:48:56.005735419 +0000 UTC m=+398.371569142" watchObservedRunningTime="2026-07-08 01:48:56.007596484 +0000 UTC m=+398.373430205"
Jul 08 01:49:06.987643 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:06.987610    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8bbd955f5-8vk9k"
Jul 08 01:49:09.492572 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:09.492537    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:09.608655 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:09.608614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:10.334384 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.334352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:10.427813 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.427767    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:10.527314 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.527278    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:10.865843 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.865808    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:10.963075 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.963041    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:10.963732 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.963698    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qxm46"]
Jul 08 01:49:10.967111 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.967095    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:10.969951 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.969929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-lg5jt\""
Jul 08 01:49:10.970161 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.970146    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 01:49:10.975936 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:10.975909    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qxm46"]
Jul 08 01:49:11.053322 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.053291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44sk\" (UniqueName: \"kubernetes.io/projected/87e19a72-9f74-49f6-a80e-05a3e59bcff5-kube-api-access-r44sk\") pod \"model-serving-api-54d89bd5fc-qxm46\" (UID: \"87e19a72-9f74-49f6-a80e-05a3e59bcff5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:11.053571 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.053377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87e19a72-9f74-49f6-a80e-05a3e59bcff5-tls-certs\") pod \"model-serving-api-54d89bd5fc-qxm46\" (UID: \"87e19a72-9f74-49f6-a80e-05a3e59bcff5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:11.054197 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.054165    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:11.154241 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.154147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r44sk\" (UniqueName: \"kubernetes.io/projected/87e19a72-9f74-49f6-a80e-05a3e59bcff5-kube-api-access-r44sk\") pod \"model-serving-api-54d89bd5fc-qxm46\" (UID: \"87e19a72-9f74-49f6-a80e-05a3e59bcff5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:11.154382 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.154280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87e19a72-9f74-49f6-a80e-05a3e59bcff5-tls-certs\") pod \"model-serving-api-54d89bd5fc-qxm46\" (UID: \"87e19a72-9f74-49f6-a80e-05a3e59bcff5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:11.156799 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.156766    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87e19a72-9f74-49f6-a80e-05a3e59bcff5-tls-certs\") pod \"model-serving-api-54d89bd5fc-qxm46\" (UID: \"87e19a72-9f74-49f6-a80e-05a3e59bcff5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:11.164427 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.164402    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44sk\" (UniqueName: \"kubernetes.io/projected/87e19a72-9f74-49f6-a80e-05a3e59bcff5-kube-api-access-r44sk\") pod \"model-serving-api-54d89bd5fc-qxm46\" (UID: \"87e19a72-9f74-49f6-a80e-05a3e59bcff5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:11.279026 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.278982    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:11.419500 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:11.419476    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qxm46"]
Jul 08 01:49:11.421912 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:49:11.421879    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e19a72_9f74_49f6_a80e_05a3e59bcff5.slice/crio-6ca8d8ae0a754f50ad4dc249bca46482c591d9f52bd2ea935c23b420e8e0c50d WatchSource:0}: Error finding container 6ca8d8ae0a754f50ad4dc249bca46482c591d9f52bd2ea935c23b420e8e0c50d: Status 404 returned error can't find the container with id 6ca8d8ae0a754f50ad4dc249bca46482c591d9f52bd2ea935c23b420e8e0c50d
Jul 08 01:49:12.056984 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:12.056932    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qxm46" event={"ID":"87e19a72-9f74-49f6-a80e-05a3e59bcff5","Type":"ContainerStarted","Data":"6ca8d8ae0a754f50ad4dc249bca46482c591d9f52bd2ea935c23b420e8e0c50d"}
Jul 08 01:49:14.067057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:14.067023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qxm46" event={"ID":"87e19a72-9f74-49f6-a80e-05a3e59bcff5","Type":"ContainerStarted","Data":"624f19123a8297587321899ebbc8b3034513927983662f39b7f89810b6e829e0"}
Jul 08 01:49:14.067429 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:14.067087    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:14.085192 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:14.085141    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qxm46" podStartSLOduration=2.351703304 podStartE2EDuration="4.085125503s" totalImagesPullingTime="1.733422199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:49:14.084138226 +0000 UTC m=+416.449971951" watchObservedRunningTime="2026-07-08 01:49:14.085125503 +0000 UTC m=+416.450959225"
Jul 08 01:49:15.495580 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.495540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:15.544246 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.544198    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"]
Jul 08 01:49:15.548159 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.548135    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.552309 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.552289    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 01:49:15.558364 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.558342    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 01:49:15.558453 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.558343    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hp4c8\""
Jul 08 01:49:15.563221 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.563196    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"]
Jul 08 01:49:15.592730 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.592672    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ff1b21-96dd-4822-8290-d52ca8622098-tls-certs\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.592921 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.592757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01ff1b21-96dd-4822-8290-d52ca8622098-tmp\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.592921 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.592807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlcv7\" (UniqueName: \"kubernetes.io/projected/01ff1b21-96dd-4822-8290-d52ca8622098-kube-api-access-mlcv7\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.693561 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.693512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ff1b21-96dd-4822-8290-d52ca8622098-tls-certs\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.693812 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.693569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01ff1b21-96dd-4822-8290-d52ca8622098-tmp\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.693812 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.693604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlcv7\" (UniqueName: \"kubernetes.io/projected/01ff1b21-96dd-4822-8290-d52ca8622098-kube-api-access-mlcv7\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.693812 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:49:15.693659    2582 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 08 01:49:15.693812 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:49:15.693769    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ff1b21-96dd-4822-8290-d52ca8622098-tls-certs podName:01ff1b21-96dd-4822-8290-d52ca8622098 nodeName:}" failed. No retries permitted until 2026-07-08 01:49:16.19375029 +0000 UTC m=+418.559584009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/01ff1b21-96dd-4822-8290-d52ca8622098-tls-certs") pod "kube-auth-proxy-84bf889db5-ljbxk" (UID: "01ff1b21-96dd-4822-8290-d52ca8622098") : secret "kube-auth-proxy-tls" not found
Jul 08 01:49:15.696045 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.696019    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01ff1b21-96dd-4822-8290-d52ca8622098-tmp\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.704150 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.704117    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlcv7\" (UniqueName: \"kubernetes.io/projected/01ff1b21-96dd-4822-8290-d52ca8622098-kube-api-access-mlcv7\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:15.994651 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:15.994610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:16.196883 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.196846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ff1b21-96dd-4822-8290-d52ca8622098-tls-certs\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:16.199379 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.199352    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01ff1b21-96dd-4822-8290-d52ca8622098-tls-certs\") pod \"kube-auth-proxy-84bf889db5-ljbxk\" (UID: \"01ff1b21-96dd-4822-8290-d52ca8622098\") " pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:16.457166 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.457124    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"
Jul 08 01:49:16.605453 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.605419    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk"]
Jul 08 01:49:16.609452 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:49:16.609422    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ff1b21_96dd_4822_8290_d52ca8622098.slice/crio-731c93aff6e5b59ef2417bca6b6685bc28442e210432ba5b4bcdad2061a52d7a WatchSource:0}: Error finding container 731c93aff6e5b59ef2417bca6b6685bc28442e210432ba5b4bcdad2061a52d7a: Status 404 returned error can't find the container with id 731c93aff6e5b59ef2417bca6b6685bc28442e210432ba5b4bcdad2061a52d7a
Jul 08 01:49:16.858566 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.858489    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"]
Jul 08 01:49:16.863141 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.863120    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:16.866069 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.866045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 01:49:16.866199 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.866089    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 01:49:16.866275 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.866267    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 01:49:16.866331 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.866285    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-t7frg\""
Jul 08 01:49:16.866530 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.866511    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 01:49:16.875619 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.875593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:16.889974 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.889939    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"]
Jul 08 01:49:16.902414 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.902381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:16.902567 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.902425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:16.902567 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.902493    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:16.902567 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.902520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:16.902567 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.902557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:16.902775 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.902581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qgjf\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-kube-api-access-5qgjf\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:16.902775 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:16.902604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a2cde3-c32c-4e86-9e91-1f93825628a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.003727 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.003681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a2cde3-c32c-4e86-9e91-1f93825628a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.003923 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.003747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.003923 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.003775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.003923 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.003812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.003923 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.003833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.003923 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.003885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.004199 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.003924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qgjf\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-kube-api-access-5qgjf\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.004459 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.004434    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.006119 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.006095    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a2cde3-c32c-4e86-9e91-1f93825628a7-local-certs\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.006222 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.006190    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-cacerts\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.006606 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.006557    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.006606 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.006594    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.007430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.007404    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:17.018494 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.018473    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-token\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.018865 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.018844    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qgjf\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-kube-api-access-5qgjf\") pod \"istiod-openshift-gateway-7574459656-r6qdj\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.082036 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.081994    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk" event={"ID":"01ff1b21-96dd-4822-8290-d52ca8622098","Type":"ContainerStarted","Data":"731c93aff6e5b59ef2417bca6b6685bc28442e210432ba5b4bcdad2061a52d7a"}
Jul 08 01:49:17.172638 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.172542    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:17.327938 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:17.327896    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"]
Jul 08 01:49:17.330055 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:49:17.330024    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a2cde3_c32c_4e86_9e91_1f93825628a7.slice/crio-095dab48bc3f4e186fff1ea8be413b049ac9e1ae1d9251d0aac9c56a5ef5003e WatchSource:0}: Error finding container 095dab48bc3f4e186fff1ea8be413b049ac9e1ae1d9251d0aac9c56a5ef5003e: Status 404 returned error can't find the container with id 095dab48bc3f4e186fff1ea8be413b049ac9e1ae1d9251d0aac9c56a5ef5003e
Jul 08 01:49:18.088383 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:18.088344    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj" event={"ID":"06a2cde3-c32c-4e86-9e91-1f93825628a7","Type":"ContainerStarted","Data":"095dab48bc3f4e186fff1ea8be413b049ac9e1ae1d9251d0aac9c56a5ef5003e"}
Jul 08 01:49:18.689901 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:18.689855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:20.497438 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.497377    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 01:49:20.497887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.497465    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 01:49:20.497887 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.497845    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 01:49:20.555171 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.555143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:20.631548 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.631508    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"]
Jul 08 01:49:20.636241 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.635475    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:20.640574 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.640223    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w4hvt\""
Jul 08 01:49:20.640574 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.640449    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 01:49:20.655005 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.654977    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"]
Jul 08 01:49:20.662433 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.662329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:20.736597 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.736557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba1d7f7-2361-430e-95c4-771bd00bf65d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zfr7f\" (UID: \"0ba1d7f7-2361-430e-95c4-771bd00bf65d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:20.736597 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.736607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv2ng\" (UniqueName: \"kubernetes.io/projected/0ba1d7f7-2361-430e-95c4-771bd00bf65d-kube-api-access-sv2ng\") pod \"llmisvc-controller-manager-777c6bd7d5-zfr7f\" (UID: \"0ba1d7f7-2361-430e-95c4-771bd00bf65d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:20.837422 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.837326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba1d7f7-2361-430e-95c4-771bd00bf65d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zfr7f\" (UID: \"0ba1d7f7-2361-430e-95c4-771bd00bf65d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:20.837628 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.837438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv2ng\" (UniqueName: \"kubernetes.io/projected/0ba1d7f7-2361-430e-95c4-771bd00bf65d-kube-api-access-sv2ng\") pod \"llmisvc-controller-manager-777c6bd7d5-zfr7f\" (UID: \"0ba1d7f7-2361-430e-95c4-771bd00bf65d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:20.837628 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:49:20.837456    2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 08 01:49:20.837628 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:49:20.837539    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ba1d7f7-2361-430e-95c4-771bd00bf65d-cert podName:0ba1d7f7-2361-430e-95c4-771bd00bf65d nodeName:}" failed. No retries permitted until 2026-07-08 01:49:21.337507826 +0000 UTC m=+423.703341547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0ba1d7f7-2361-430e-95c4-771bd00bf65d-cert") pod "llmisvc-controller-manager-777c6bd7d5-zfr7f" (UID: "0ba1d7f7-2361-430e-95c4-771bd00bf65d") : secret "llmisvc-webhook-server-cert" not found
Jul 08 01:49:20.874698 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:20.874666    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv2ng\" (UniqueName: \"kubernetes.io/projected/0ba1d7f7-2361-430e-95c4-771bd00bf65d-kube-api-access-sv2ng\") pod \"llmisvc-controller-manager-777c6bd7d5-zfr7f\" (UID: \"0ba1d7f7-2361-430e-95c4-771bd00bf65d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:21.016258 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.016215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:21.111354 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.111254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk" event={"ID":"01ff1b21-96dd-4822-8290-d52ca8622098","Type":"ContainerStarted","Data":"b16edfb3cc09e6a1346f2dd92fc50062f31d7e64b381f2f625192a802a6620c0"}
Jul 08 01:49:21.112848 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.112819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj" event={"ID":"06a2cde3-c32c-4e86-9e91-1f93825628a7","Type":"ContainerStarted","Data":"35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f"}
Jul 08 01:49:21.113013 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.112992    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:21.114865 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.114841    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-r6qdj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 01:49:21.114976 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.114891    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj" podUID="06a2cde3-c32c-4e86-9e91-1f93825628a7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 01:49:21.138527 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.138467    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84bf889db5-ljbxk" podStartSLOduration=2.255653885 podStartE2EDuration="6.138450533s" totalImagesPullingTime="3.882796648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:49:21.136543931 +0000 UTC m=+423.502377653" watchObservedRunningTime="2026-07-08 01:49:21.138450533 +0000 UTC m=+423.504284256"
Jul 08 01:49:21.163694 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.163631    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj" podStartSLOduration=1.998842506 podStartE2EDuration="5.163609597s" totalImagesPullingTime="3.164767091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:49:21.162186112 +0000 UTC m=+423.528019834" watchObservedRunningTime="2026-07-08 01:49:21.163609597 +0000 UTC m=+423.529443322"
Jul 08 01:49:21.342856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.342818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba1d7f7-2361-430e-95c4-771bd00bf65d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zfr7f\" (UID: \"0ba1d7f7-2361-430e-95c4-771bd00bf65d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:21.345440 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.345398    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba1d7f7-2361-430e-95c4-771bd00bf65d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zfr7f\" (UID: \"0ba1d7f7-2361-430e-95c4-771bd00bf65d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:21.549060 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.549016    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:21.729741 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.729637    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:21.741453 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.741420    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"]
Jul 08 01:49:21.745422 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:49:21.745396    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ba1d7f7_2361_430e_95c4_771bd00bf65d.slice/crio-332ebb9e7df646a163b67baf18d8e0ab3577ac15e0101a12ab93c3107088a2ff WatchSource:0}: Error finding container 332ebb9e7df646a163b67baf18d8e0ab3577ac15e0101a12ab93c3107088a2ff: Status 404 returned error can't find the container with id 332ebb9e7df646a163b67baf18d8e0ab3577ac15e0101a12ab93c3107088a2ff
Jul 08 01:49:21.840882 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.840796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:21.946195 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:21.946154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:22.095955 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:22.095873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:22.118676 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:22.118643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f" event={"ID":"0ba1d7f7-2361-430e-95c4-771bd00bf65d","Type":"ContainerStarted","Data":"332ebb9e7df646a163b67baf18d8e0ab3577ac15e0101a12ab93c3107088a2ff"}
Jul 08 01:49:22.119395 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:22.119373    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-r6qdj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 01:49:22.119505 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:22.119417    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj" podUID="06a2cde3-c32c-4e86-9e91-1f93825628a7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 01:49:22.846519 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:22.846488    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:23.301013 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:23.300977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:23.507343 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:23.507306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:25.075326 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:25.075293    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qxm46"
Jul 08 01:49:25.120260 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:25.120235    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:25.823791 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:25.823756    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"]
Jul 08 01:49:25.824006 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:25.823935    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj" podUID="06a2cde3-c32c-4e86-9e91-1f93825628a7" containerName="discovery" containerID="cri-o://35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f" gracePeriod=30
Jul 08 01:49:26.077171 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.077110    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:26.143354 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.143313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f" event={"ID":"0ba1d7f7-2361-430e-95c4-771bd00bf65d","Type":"ContainerStarted","Data":"5574863898a590b8b73fb6d330392b9f69e6f9fd77fc0a32252a423100272756"}
Jul 08 01:49:26.143576 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.143418    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:49:26.144658 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.144630    2582 generic.go:356] "Generic (PLEG): container finished" podID="06a2cde3-c32c-4e86-9e91-1f93825628a7" containerID="35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f" exitCode=0
Jul 08 01:49:26.144770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.144676    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"
Jul 08 01:49:26.144770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.144723    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj" event={"ID":"06a2cde3-c32c-4e86-9e91-1f93825628a7","Type":"ContainerDied","Data":"35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f"}
Jul 08 01:49:26.144770 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.144767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj" event={"ID":"06a2cde3-c32c-4e86-9e91-1f93825628a7","Type":"ContainerDied","Data":"095dab48bc3f4e186fff1ea8be413b049ac9e1ae1d9251d0aac9c56a5ef5003e"}
Jul 08 01:49:26.144879 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.144787    2582 scope.go:117] "RemoveContainer" containerID="35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f"
Jul 08 01:49:26.153076 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.153054    2582 scope.go:117] "RemoveContainer" containerID="35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f"
Jul 08 01:49:26.153346 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:49:26.153321    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f\": container with ID starting with 35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f not found: ID does not exist" containerID="35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f"
Jul 08 01:49:26.153404 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.153357    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f"} err="failed to get container status \"35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f\": rpc error: code = NotFound desc = could not find container \"35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f\": container with ID starting with 35542df4dcf55162945e928246358f1441f9d92ed8a4448379b73178ff631e1f not found: ID does not exist"
Jul 08 01:49:26.162942 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.162904    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f" podStartSLOduration=2.832358264 podStartE2EDuration="6.162889238s" totalImagesPullingTime="3.330530974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:49:26.160971209 +0000 UTC m=+428.526804934" watchObservedRunningTime="2026-07-08 01:49:26.162889238 +0000 UTC m=+428.528722959"
Jul 08 01:49:26.187678 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.187652    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-cacerts\") pod \"06a2cde3-c32c-4e86-9e91-1f93825628a7\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") "
Jul 08 01:49:26.187846 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.187701    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-dns-cert\") pod \"06a2cde3-c32c-4e86-9e91-1f93825628a7\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") "
Jul 08 01:49:26.187846 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.187752    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qgjf\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-kube-api-access-5qgjf\") pod \"06a2cde3-c32c-4e86-9e91-1f93825628a7\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") "
Jul 08 01:49:26.187846 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.187769    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-token\") pod \"06a2cde3-c32c-4e86-9e91-1f93825628a7\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") "
Jul 08 01:49:26.187846 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.187789    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-kubeconfig\") pod \"06a2cde3-c32c-4e86-9e91-1f93825628a7\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") "
Jul 08 01:49:26.188057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.187854    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a2cde3-c32c-4e86-9e91-1f93825628a7-local-certs\") pod \"06a2cde3-c32c-4e86-9e91-1f93825628a7\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") "
Jul 08 01:49:26.188057 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.187878    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-ca-configmap\") pod \"06a2cde3-c32c-4e86-9e91-1f93825628a7\" (UID: \"06a2cde3-c32c-4e86-9e91-1f93825628a7\") "
Jul 08 01:49:26.188984 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.188951    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "06a2cde3-c32c-4e86-9e91-1f93825628a7" (UID: "06a2cde3-c32c-4e86-9e91-1f93825628a7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 01:49:26.190250 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.190227    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-cacerts" (OuterVolumeSpecName: "cacerts") pod "06a2cde3-c32c-4e86-9e91-1f93825628a7" (UID: "06a2cde3-c32c-4e86-9e91-1f93825628a7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 01:49:26.190372 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.190252    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "06a2cde3-c32c-4e86-9e91-1f93825628a7" (UID: "06a2cde3-c32c-4e86-9e91-1f93825628a7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 01:49:26.190372 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.190337    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-kube-api-access-5qgjf" (OuterVolumeSpecName: "kube-api-access-5qgjf") pod "06a2cde3-c32c-4e86-9e91-1f93825628a7" (UID: "06a2cde3-c32c-4e86-9e91-1f93825628a7"). InnerVolumeSpecName "kube-api-access-5qgjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:49:26.190372 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.190337    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a2cde3-c32c-4e86-9e91-1f93825628a7-local-certs" (OuterVolumeSpecName: "local-certs") pod "06a2cde3-c32c-4e86-9e91-1f93825628a7" (UID: "06a2cde3-c32c-4e86-9e91-1f93825628a7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 01:49:26.190500 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.190381    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "06a2cde3-c32c-4e86-9e91-1f93825628a7" (UID: "06a2cde3-c32c-4e86-9e91-1f93825628a7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 01:49:26.190500 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.190389    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "06a2cde3-c32c-4e86-9e91-1f93825628a7" (UID: "06a2cde3-c32c-4e86-9e91-1f93825628a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:49:26.289495 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.289465    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-dns-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:49:26.289495 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.289489    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qgjf\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-kube-api-access-5qgjf\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:49:26.289495 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.289502    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:49:26.289495 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.289510    2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-kubeconfig\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:49:26.289495 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.289518    2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06a2cde3-c32c-4e86-9e91-1f93825628a7-local-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:49:26.289879 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.289528    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06a2cde3-c32c-4e86-9e91-1f93825628a7-istio-csr-ca-configmap\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:49:26.289879 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.289540    2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06a2cde3-c32c-4e86-9e91-1f93825628a7-cacerts\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:49:26.487881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.487836    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"]
Jul 08 01:49:26.494702 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:26.494672    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-r6qdj"]
Jul 08 01:49:28.164469 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:28.164429    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a2cde3-c32c-4e86-9e91-1f93825628a7" path="/var/lib/kubelet/pods/06a2cde3-c32c-4e86-9e91-1f93825628a7/volumes"
Jul 08 01:49:35.958633 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:35.958599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:49:57.152686 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:49:57.152604    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zfr7f"
Jul 08 01:50:11.056130 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.056082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:11.145008 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.144956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:11.207387 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.207344    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6sk5"]
Jul 08 01:50:11.207855 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.207825    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a2cde3-c32c-4e86-9e91-1f93825628a7" containerName="discovery"
Jul 08 01:50:11.207855 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.207852    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a2cde3-c32c-4e86-9e91-1f93825628a7" containerName="discovery"
Jul 08 01:50:11.208099 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.207931    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a2cde3-c32c-4e86-9e91-1f93825628a7" containerName="discovery"
Jul 08 01:50:11.211518 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.211493    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g6sk5"
Jul 08 01:50:11.214338 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.214311    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 01:50:11.214467 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.214313    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 01:50:11.215440 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.215422    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mccdf\""
Jul 08 01:50:11.222778 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.222740    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6sk5"]
Jul 08 01:50:11.255517 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.255479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:11.258217 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.258194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4mn2\" (UniqueName: \"kubernetes.io/projected/ab18a1e8-2fc7-4691-9e12-619f28a86e82-kube-api-access-h4mn2\") pod \"kuadrant-operator-catalog-g6sk5\" (UID: \"ab18a1e8-2fc7-4691-9e12-619f28a86e82\") " pod="kuadrant-system/kuadrant-operator-catalog-g6sk5"
Jul 08 01:50:11.359629 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.359538    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4mn2\" (UniqueName: \"kubernetes.io/projected/ab18a1e8-2fc7-4691-9e12-619f28a86e82-kube-api-access-h4mn2\") pod \"kuadrant-operator-catalog-g6sk5\" (UID: \"ab18a1e8-2fc7-4691-9e12-619f28a86e82\") " pod="kuadrant-system/kuadrant-operator-catalog-g6sk5"
Jul 08 01:50:11.370109 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.370076    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4mn2\" (UniqueName: \"kubernetes.io/projected/ab18a1e8-2fc7-4691-9e12-619f28a86e82-kube-api-access-h4mn2\") pod \"kuadrant-operator-catalog-g6sk5\" (UID: \"ab18a1e8-2fc7-4691-9e12-619f28a86e82\") " pod="kuadrant-system/kuadrant-operator-catalog-g6sk5"
Jul 08 01:50:11.524482 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.524443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g6sk5"
Jul 08 01:50:11.561339 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.561307    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6sk5"]
Jul 08 01:50:11.654364 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.654337    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6sk5"]
Jul 08 01:50:11.656329 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:50:11.656301    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab18a1e8_2fc7_4691_9e12_619f28a86e82.slice/crio-1a562ce21ff5a2b887debfe900cda9ceb3973fa521be38fa8bb0231ae219c109 WatchSource:0}: Error finding container 1a562ce21ff5a2b887debfe900cda9ceb3973fa521be38fa8bb0231ae219c109: Status 404 returned error can't find the container with id 1a562ce21ff5a2b887debfe900cda9ceb3973fa521be38fa8bb0231ae219c109
Jul 08 01:50:11.768512 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.768481    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jfsl"]
Jul 08 01:50:11.772984 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.772966    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:11.780255 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.780236    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jfsl"]
Jul 08 01:50:11.863023 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.862987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9fdv\" (UniqueName: \"kubernetes.io/projected/f2725a78-7b45-4e07-928a-ef1171ab9363-kube-api-access-b9fdv\") pod \"kuadrant-operator-catalog-2jfsl\" (UID: \"f2725a78-7b45-4e07-928a-ef1171ab9363\") " pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:11.963982 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.963940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9fdv\" (UniqueName: \"kubernetes.io/projected/f2725a78-7b45-4e07-928a-ef1171ab9363-kube-api-access-b9fdv\") pod \"kuadrant-operator-catalog-2jfsl\" (UID: \"f2725a78-7b45-4e07-928a-ef1171ab9363\") " pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:11.972373 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:11.972349    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9fdv\" (UniqueName: \"kubernetes.io/projected/f2725a78-7b45-4e07-928a-ef1171ab9363-kube-api-access-b9fdv\") pod \"kuadrant-operator-catalog-2jfsl\" (UID: \"f2725a78-7b45-4e07-928a-ef1171ab9363\") " pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:12.083846 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:12.083805    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:12.216194 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:12.216169    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2jfsl"]
Jul 08 01:50:12.217664 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:50:12.217637    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2725a78_7b45_4e07_928a_ef1171ab9363.slice/crio-7f925e138acb938b59bc348bbeeb2aeafa2ba75aec51fc3ee3713cf7925fc395 WatchSource:0}: Error finding container 7f925e138acb938b59bc348bbeeb2aeafa2ba75aec51fc3ee3713cf7925fc395: Status 404 returned error can't find the container with id 7f925e138acb938b59bc348bbeeb2aeafa2ba75aec51fc3ee3713cf7925fc395
Jul 08 01:50:12.361071 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:12.361031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl" event={"ID":"f2725a78-7b45-4e07-928a-ef1171ab9363","Type":"ContainerStarted","Data":"7f925e138acb938b59bc348bbeeb2aeafa2ba75aec51fc3ee3713cf7925fc395"}
Jul 08 01:50:12.362232 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:12.362208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g6sk5" event={"ID":"ab18a1e8-2fc7-4691-9e12-619f28a86e82","Type":"ContainerStarted","Data":"1a562ce21ff5a2b887debfe900cda9ceb3973fa521be38fa8bb0231ae219c109"}
Jul 08 01:50:13.713849 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:50:13.713795    2582 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:d6b1b89eccacc15c2420b2776d72c1dae334a00805ed9af54bf2f71e4d536f28: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/kuadrant/kuadrant-operator-catalog:v1.4.2"
Jul 08 01:50:13.714273 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:50:13.713940    2582 kuberuntime_manager.go:1459] "Unhandled Error" err="container registry-server start failed in pod kuadrant-operator-catalog-g6sk5_kuadrant-system(ab18a1e8-2fc7-4691-9e12-619f28a86e82): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:d6b1b89eccacc15c2420b2776d72c1dae334a00805ed9af54bf2f71e4d536f28: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 08 01:50:13.714273 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:50:13.713986    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry-server\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:d6b1b89eccacc15c2420b2776d72c1dae334a00805ed9af54bf2f71e4d536f28: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/kuadrant-operator-catalog-g6sk5" podUID="ab18a1e8-2fc7-4691-9e12-619f28a86e82"
Jul 08 01:50:14.377199 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:14.377158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl" event={"ID":"f2725a78-7b45-4e07-928a-ef1171ab9363","Type":"ContainerStarted","Data":"caa050fca08af0015bbc3139698c13af06d59b1fb145337623399c6c995e4446"}
Jul 08 01:50:14.394350 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:14.394302    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl" podStartSLOduration=1.718715 podStartE2EDuration="3.394285805s" totalImagesPullingTime="1.675570805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:50:14.39353921 +0000 UTC m=+476.759372947" watchObservedRunningTime="2026-07-08 01:50:14.394285805 +0000 UTC m=+476.760119538"
Jul 08 01:50:14.511899 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:14.511873    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g6sk5"
Jul 08 01:50:14.587903 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:14.587864    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4mn2\" (UniqueName: \"kubernetes.io/projected/ab18a1e8-2fc7-4691-9e12-619f28a86e82-kube-api-access-h4mn2\") pod \"ab18a1e8-2fc7-4691-9e12-619f28a86e82\" (UID: \"ab18a1e8-2fc7-4691-9e12-619f28a86e82\") "
Jul 08 01:50:14.590008 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:14.589985    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab18a1e8-2fc7-4691-9e12-619f28a86e82-kube-api-access-h4mn2" (OuterVolumeSpecName: "kube-api-access-h4mn2") pod "ab18a1e8-2fc7-4691-9e12-619f28a86e82" (UID: "ab18a1e8-2fc7-4691-9e12-619f28a86e82"). InnerVolumeSpecName "kube-api-access-h4mn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:50:14.689143 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:14.689110    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4mn2\" (UniqueName: \"kubernetes.io/projected/ab18a1e8-2fc7-4691-9e12-619f28a86e82-kube-api-access-h4mn2\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:50:15.383026 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:15.382994    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g6sk5"
Jul 08 01:50:15.383502 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:15.383029    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g6sk5" event={"ID":"ab18a1e8-2fc7-4691-9e12-619f28a86e82","Type":"ContainerDied","Data":"1a562ce21ff5a2b887debfe900cda9ceb3973fa521be38fa8bb0231ae219c109"}
Jul 08 01:50:15.435380 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:15.435344    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6sk5"]
Jul 08 01:50:15.438456 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:15.438425    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6sk5"]
Jul 08 01:50:16.165301 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:16.165263    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab18a1e8-2fc7-4691-9e12-619f28a86e82" path="/var/lib/kubelet/pods/ab18a1e8-2fc7-4691-9e12-619f28a86e82/volumes"
Jul 08 01:50:17.903218 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:17.903184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:17.964466 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:17.964414    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:22.084450 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:22.084410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:22.084911 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:22.084482    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:22.107096 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:22.107063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:22.434932 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:22.434861    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2jfsl"
Jul 08 01:50:29.018896 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:29.018847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:29.085109 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:29.085074    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:29.180284 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:29.180237    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:32.190065 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:32.190024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:32.263190 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:32.263141    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:34.312048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:34.312003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:34.380972 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:34.380940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:39.406288 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:39.406236    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:40.006322 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:40.006283    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:41.114446 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:41.114412    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:43.521009 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.520972    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"]
Jul 08 01:50:43.524336 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.524315    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"
Jul 08 01:50:43.527453 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.527435    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-42g5m\""
Jul 08 01:50:43.537879 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.537852    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"]
Jul 08 01:50:43.640905 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.640863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd4n4\" (UniqueName: \"kubernetes.io/projected/20d9f101-e3ae-4f53-bb52-5b27ad436f40-kube-api-access-vd4n4\") pod \"authorino-operator-75cc8d5cb7-nmfj2\" (UID: \"20d9f101-e3ae-4f53-bb52-5b27ad436f40\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"
Jul 08 01:50:43.741694 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.741653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd4n4\" (UniqueName: \"kubernetes.io/projected/20d9f101-e3ae-4f53-bb52-5b27ad436f40-kube-api-access-vd4n4\") pod \"authorino-operator-75cc8d5cb7-nmfj2\" (UID: \"20d9f101-e3ae-4f53-bb52-5b27ad436f40\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"
Jul 08 01:50:43.754692 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.754658    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd4n4\" (UniqueName: \"kubernetes.io/projected/20d9f101-e3ae-4f53-bb52-5b27ad436f40-kube-api-access-vd4n4\") pod \"authorino-operator-75cc8d5cb7-nmfj2\" (UID: \"20d9f101-e3ae-4f53-bb52-5b27ad436f40\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"
Jul 08 01:50:43.834913 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.834805    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"
Jul 08 01:50:43.994231 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:43.994207    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"]
Jul 08 01:50:43.995943 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:50:43.995917    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d9f101_e3ae_4f53_bb52_5b27ad436f40.slice/crio-2ff3d2916b54b5e5bbcd0861aed7c1872c0bd839825a8eac1462abe35504d7cd WatchSource:0}: Error finding container 2ff3d2916b54b5e5bbcd0861aed7c1872c0bd839825a8eac1462abe35504d7cd: Status 404 returned error can't find the container with id 2ff3d2916b54b5e5bbcd0861aed7c1872c0bd839825a8eac1462abe35504d7cd
Jul 08 01:50:44.512566 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:44.512532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2" event={"ID":"20d9f101-e3ae-4f53-bb52-5b27ad436f40","Type":"ContainerStarted","Data":"2ff3d2916b54b5e5bbcd0861aed7c1872c0bd839825a8eac1462abe35504d7cd"}
Jul 08 01:50:44.644679 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:44.644637    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:46.295967 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.295930    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"]
Jul 08 01:50:46.299865 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.299842    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"
Jul 08 01:50:46.306297 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.306200    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 01:50:46.306297 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.306245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jclqh\""
Jul 08 01:50:46.313977 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.313949    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"]
Jul 08 01:50:46.464958 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.464931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7w9r\" (UniqueName: \"kubernetes.io/projected/60da9b3c-eca9-4eff-848d-daf4f566df33-kube-api-access-v7w9r\") pod \"dns-operator-controller-manager-864dd78c4c-km2rq\" (UID: \"60da9b3c-eca9-4eff-848d-daf4f566df33\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"
Jul 08 01:50:46.525562 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.525516    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2" event={"ID":"20d9f101-e3ae-4f53-bb52-5b27ad436f40","Type":"ContainerStarted","Data":"6de9712f46f4c53ee5d2c7eef87c1999dccf0af7f3928aac86b400cb7eed5f28"}
Jul 08 01:50:46.525797 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.525697    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"
Jul 08 01:50:46.544626 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.544572    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2" podStartSLOduration=1.134669949 podStartE2EDuration="3.544557063s" totalImagesPullingTime="2.409887114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:50:46.542825469 +0000 UTC m=+508.908659192" watchObservedRunningTime="2026-07-08 01:50:46.544557063 +0000 UTC m=+508.910390795"
Jul 08 01:50:46.566044 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.565963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7w9r\" (UniqueName: \"kubernetes.io/projected/60da9b3c-eca9-4eff-848d-daf4f566df33-kube-api-access-v7w9r\") pod \"dns-operator-controller-manager-864dd78c4c-km2rq\" (UID: \"60da9b3c-eca9-4eff-848d-daf4f566df33\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"
Jul 08 01:50:46.587089 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.587061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7w9r\" (UniqueName: \"kubernetes.io/projected/60da9b3c-eca9-4eff-848d-daf4f566df33-kube-api-access-v7w9r\") pod \"dns-operator-controller-manager-864dd78c4c-km2rq\" (UID: \"60da9b3c-eca9-4eff-848d-daf4f566df33\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"
Jul 08 01:50:46.614856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.614820    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"
Jul 08 01:50:46.762188 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:46.762157    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"]
Jul 08 01:50:46.764174 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:50:46.764149    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60da9b3c_eca9_4eff_848d_daf4f566df33.slice/crio-57f64043d12b210e0881c19d4ddf57642a5de4c57e71b97f7277ee0581018c88 WatchSource:0}: Error finding container 57f64043d12b210e0881c19d4ddf57642a5de4c57e71b97f7277ee0581018c88: Status 404 returned error can't find the container with id 57f64043d12b210e0881c19d4ddf57642a5de4c57e71b97f7277ee0581018c88
Jul 08 01:50:47.023096 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:47.023065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:47.282441 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:47.282356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:47.532203 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:47.532168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq" event={"ID":"60da9b3c-eca9-4eff-848d-daf4f566df33","Type":"ContainerStarted","Data":"57f64043d12b210e0881c19d4ddf57642a5de4c57e71b97f7277ee0581018c88"}
Jul 08 01:50:49.044856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.044820    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"]
Jul 08 01:50:49.048763 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.048739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:50:49.051821 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.051803    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5lddw\""
Jul 08 01:50:49.061673 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.061649    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"]
Jul 08 01:50:49.186417 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.186378    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggrkc\" (UniqueName: \"kubernetes.io/projected/da53b5a7-6cbd-4e02-a017-536326591616-kube-api-access-ggrkc\") pod \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" (UID: \"da53b5a7-6cbd-4e02-a017-536326591616\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:50:49.287492 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.287445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggrkc\" (UniqueName: \"kubernetes.io/projected/da53b5a7-6cbd-4e02-a017-536326591616-kube-api-access-ggrkc\") pod \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" (UID: \"da53b5a7-6cbd-4e02-a017-536326591616\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:50:49.297483 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.297413    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggrkc\" (UniqueName: \"kubernetes.io/projected/da53b5a7-6cbd-4e02-a017-536326591616-kube-api-access-ggrkc\") pod \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" (UID: \"da53b5a7-6cbd-4e02-a017-536326591616\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:50:49.362207 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.362160    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:50:49.465177 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.465137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:49.510104 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.509956    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"]
Jul 08 01:50:49.512860 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:50:49.512826    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda53b5a7_6cbd_4e02_a017_536326591616.slice/crio-4ba4a356c4a12115e06b98c018a146f12d1e95275602c2fad6114cf3346d4715 WatchSource:0}: Error finding container 4ba4a356c4a12115e06b98c018a146f12d1e95275602c2fad6114cf3346d4715: Status 404 returned error can't find the container with id 4ba4a356c4a12115e06b98c018a146f12d1e95275602c2fad6114cf3346d4715
Jul 08 01:50:49.544628 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.544587    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq" event={"ID":"60da9b3c-eca9-4eff-848d-daf4f566df33","Type":"ContainerStarted","Data":"a14042b2ee0001f24086b6b57f9ae7323e38ff3b3a9878b8ab93596ff061301f"}
Jul 08 01:50:49.544847 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.544759    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"
Jul 08 01:50:49.545863 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.545840    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7" event={"ID":"da53b5a7-6cbd-4e02-a017-536326591616","Type":"ContainerStarted","Data":"4ba4a356c4a12115e06b98c018a146f12d1e95275602c2fad6114cf3346d4715"}
Jul 08 01:50:49.565921 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.565823    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq" podStartSLOduration=0.968795744 podStartE2EDuration="3.565806088s" totalImagesPullingTime="2.597010344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:50:49.563574951 +0000 UTC m=+511.929408672" watchObservedRunningTime="2026-07-08 01:50:49.565806088 +0000 UTC m=+511.931639882"
Jul 08 01:50:49.621052 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:49.621021    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:52.081451 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:52.081394    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:52.568100 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:52.568062    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7" event={"ID":"da53b5a7-6cbd-4e02-a017-536326591616","Type":"ContainerStarted","Data":"e96f73ee5b94ab10c7a0f4ef8d330dee2d1baa24ba7163e2858bc33ba5ef00bc"}
Jul 08 01:50:52.568275 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:52.568197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:50:52.588071 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:52.588016    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7" podStartSLOduration=1.541005965 podStartE2EDuration="3.587999786s" totalImagesPullingTime="2.046993821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:50:52.5864112 +0000 UTC m=+514.952244918" watchObservedRunningTime="2026-07-08 01:50:52.587999786 +0000 UTC m=+514.953833519"
Jul 08 01:50:53.251702 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.251669    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"]
Jul 08 01:50:53.255213 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.255192    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:53.258514 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.258492    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dhp5g\""
Jul 08 01:50:53.276532 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.276506    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"]
Jul 08 01:50:53.423295 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.423251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxqfq\" (UniqueName: \"kubernetes.io/projected/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-kube-api-access-fxqfq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" (UID: \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:53.423492 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.423438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" (UID: \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:53.523978 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.523888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxqfq\" (UniqueName: \"kubernetes.io/projected/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-kube-api-access-fxqfq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" (UID: \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:53.524127 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.524010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" (UID: \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:53.524342 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.524325    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" (UID: \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:53.537176 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.537143    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxqfq\" (UniqueName: \"kubernetes.io/projected/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-kube-api-access-fxqfq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" (UID: \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:53.565095 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.565060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:53.700639 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:53.700606    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"]
Jul 08 01:50:53.704646 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:50:53.704615    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0e63ba_6d0a_4357_940a_f2ba3ce4e284.slice/crio-2984277c811f56304993491cb7ec22837fef56a9d25b7b3cf7bb4ff3709c1279 WatchSource:0}: Error finding container 2984277c811f56304993491cb7ec22837fef56a9d25b7b3cf7bb4ff3709c1279: Status 404 returned error can't find the container with id 2984277c811f56304993491cb7ec22837fef56a9d25b7b3cf7bb4ff3709c1279
Jul 08 01:50:54.578562 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:54.578525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t" event={"ID":"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284","Type":"ContainerStarted","Data":"2984277c811f56304993491cb7ec22837fef56a9d25b7b3cf7bb4ff3709c1279"}
Jul 08 01:50:54.631876 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:54.631842    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:54.736285 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:54.736246    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:54.882105 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:54.882022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:54.976542 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:54.976508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:57.535012 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:57.534977    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nmfj2"
Jul 08 01:50:58.432443 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:58.432341    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:58.534342 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:58.534292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:50:59.607388 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:59.607311    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t" event={"ID":"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284","Type":"ContainerStarted","Data":"8300af7842e1c0509b290f360a9acd38b66805a18be50d28fd16fc1910b71e81"}
Jul 08 01:50:59.607388 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:59.607379    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:50:59.628373 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:50:59.628323    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t" podStartSLOduration=1.068986207 podStartE2EDuration="6.628306819s" totalImagesPullingTime="5.559320612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:50:59.62723407 +0000 UTC m=+521.993067793" watchObservedRunningTime="2026-07-08 01:50:59.628306819 +0000 UTC m=+521.994140542"
Jul 08 01:51:00.559459 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:00.559425    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-km2rq"
Jul 08 01:51:02.130776 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:02.130741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:02.630797 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:02.630764    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:02.731453 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:02.731420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:03.575830 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:03.575795    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:06.018721 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:06.018681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:06.126042 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:06.125997    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:10.614720 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:10.614623    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:12.398915 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.398879    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"]
Jul 08 01:51:12.399368 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.399045    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" containerName="manager" containerID="cri-o://8300af7842e1c0509b290f360a9acd38b66805a18be50d28fd16fc1910b71e81" gracePeriod=2
Jul 08 01:51:12.413243 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.413213    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"]
Jul 08 01:51:12.427808 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:12.427762    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-p754t\": pods \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:12.431637 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.431268    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"]
Jul 08 01:51:12.431845 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.431821    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" containerName="manager"
Jul 08 01:51:12.431845 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.431844    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" containerName="manager"
Jul 08 01:51:12.432041 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.431950    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" containerName="manager"
Jul 08 01:51:12.435337 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.435305    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:12.439607 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:12.439572    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:12.440849 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.440826    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"]
Jul 08 01:51:12.441055 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.441032    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7" podUID="da53b5a7-6cbd-4e02-a017-536326591616" containerName="manager" containerID="cri-o://e96f73ee5b94ab10c7a0f4ef8d330dee2d1baa24ba7163e2858bc33ba5ef00bc" gracePeriod=2
Jul 08 01:51:12.463780 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.463747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"]
Jul 08 01:51:12.465307 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.465279    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"]
Jul 08 01:51:12.483116 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.483087    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"]
Jul 08 01:51:12.483492 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.483475    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da53b5a7-6cbd-4e02-a017-536326591616" containerName="manager"
Jul 08 01:51:12.483539 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.483495    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="da53b5a7-6cbd-4e02-a017-536326591616" containerName="manager"
Jul 08 01:51:12.483574 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.483560    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="da53b5a7-6cbd-4e02-a017-536326591616" containerName="manager"
Jul 08 01:51:12.486568 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.486548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"
Jul 08 01:51:12.491133 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.491107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcwbz\" (UniqueName: \"kubernetes.io/projected/52779a18-cc15-4bc5-af54-d3c89d5c4e69-kube-api-access-xcwbz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9whc\" (UID: \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:12.491262 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.491172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52779a18-cc15-4bc5-af54-d3c89d5c4e69-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9whc\" (UID: \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:12.498377 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:12.498329    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="da53b5a7-6cbd-4e02-a017-536326591616" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:12.500847 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:12.500813    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:12.506187 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.506153    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"]
Jul 08 01:51:12.593375 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.592615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52779a18-cc15-4bc5-af54-d3c89d5c4e69-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9whc\" (UID: \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:12.593375 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.593162    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52779a18-cc15-4bc5-af54-d3c89d5c4e69-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9whc\" (UID: \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:12.593622 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.593419    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8nn8\" (UniqueName: \"kubernetes.io/projected/4ba4e908-55f5-4686-91ef-23ef4c019735-kube-api-access-b8nn8\") pod \"limitador-operator-controller-manager-859d7b78bd-5zjnp\" (UID: \"4ba4e908-55f5-4686-91ef-23ef4c019735\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"
Jul 08 01:51:12.593622 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.593478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcwbz\" (UniqueName: \"kubernetes.io/projected/52779a18-cc15-4bc5-af54-d3c89d5c4e69-kube-api-access-xcwbz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9whc\" (UID: \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:12.607046 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.607014    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcwbz\" (UniqueName: \"kubernetes.io/projected/52779a18-cc15-4bc5-af54-d3c89d5c4e69-kube-api-access-xcwbz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k9whc\" (UID: \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:12.675386 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.675355    2582 generic.go:356] "Generic (PLEG): container finished" podID="da53b5a7-6cbd-4e02-a017-536326591616" containerID="e96f73ee5b94ab10c7a0f4ef8d330dee2d1baa24ba7163e2858bc33ba5ef00bc" exitCode=0
Jul 08 01:51:12.677043 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.677016    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" containerID="8300af7842e1c0509b290f360a9acd38b66805a18be50d28fd16fc1910b71e81" exitCode=0
Jul 08 01:51:12.689257 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.689235    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:12.691826 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:12.691797    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="da53b5a7-6cbd-4e02-a017-536326591616" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:12.692104 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.692090    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:12.694114 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:12.694082    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:12.694267 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.694252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8nn8\" (UniqueName: \"kubernetes.io/projected/4ba4e908-55f5-4686-91ef-23ef4c019735-kube-api-access-b8nn8\") pod \"limitador-operator-controller-manager-859d7b78bd-5zjnp\" (UID: \"4ba4e908-55f5-4686-91ef-23ef4c019735\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"
Jul 08 01:51:12.696162 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:12.696140    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:12.698368 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:12.698349    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="da53b5a7-6cbd-4e02-a017-536326591616" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:12.705651 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.705627    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8nn8\" (UniqueName: \"kubernetes.io/projected/4ba4e908-55f5-4686-91ef-23ef4c019735-kube-api-access-b8nn8\") pod \"limitador-operator-controller-manager-859d7b78bd-5zjnp\" (UID: \"4ba4e908-55f5-4686-91ef-23ef4c019735\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"
Jul 08 01:51:12.795561 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.795526    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-extensions-socket-volume\") pod \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\" (UID: \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\") "
Jul 08 01:51:12.795561 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.795568    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggrkc\" (UniqueName: \"kubernetes.io/projected/da53b5a7-6cbd-4e02-a017-536326591616-kube-api-access-ggrkc\") pod \"da53b5a7-6cbd-4e02-a017-536326591616\" (UID: \"da53b5a7-6cbd-4e02-a017-536326591616\") "
Jul 08 01:51:12.795812 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.795695    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxqfq\" (UniqueName: \"kubernetes.io/projected/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-kube-api-access-fxqfq\") pod \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\" (UID: \"4b0e63ba-6d0a-4357-940a-f2ba3ce4e284\") "
Jul 08 01:51:12.796119 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.796090    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" (UID: "4b0e63ba-6d0a-4357-940a-f2ba3ce4e284"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 01:51:12.797852 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.797834    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da53b5a7-6cbd-4e02-a017-536326591616-kube-api-access-ggrkc" (OuterVolumeSpecName: "kube-api-access-ggrkc") pod "da53b5a7-6cbd-4e02-a017-536326591616" (UID: "da53b5a7-6cbd-4e02-a017-536326591616"). InnerVolumeSpecName "kube-api-access-ggrkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:51:12.797961 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.797938    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-kube-api-access-fxqfq" (OuterVolumeSpecName: "kube-api-access-fxqfq") pod "4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" (UID: "4b0e63ba-6d0a-4357-940a-f2ba3ce4e284"). InnerVolumeSpecName "kube-api-access-fxqfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:51:12.830172 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.830134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:12.836092 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.836072    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"
Jul 08 01:51:12.896650 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.896561    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxqfq\" (UniqueName: \"kubernetes.io/projected/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-kube-api-access-fxqfq\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:51:12.896650 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.896598    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284-extensions-socket-volume\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:51:12.896650 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.896617    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggrkc\" (UniqueName: \"kubernetes.io/projected/da53b5a7-6cbd-4e02-a017-536326591616-kube-api-access-ggrkc\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:51:12.983027 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.983003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"]
Jul 08 01:51:12.985424 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:51:12.985399    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52779a18_cc15_4bc5_af54_d3c89d5c4e69.slice/crio-e49ac47445c1ed51d78fa2f15dec8bb8be619a45b6f9746871bfc0e0ee8e2093 WatchSource:0}: Error finding container e49ac47445c1ed51d78fa2f15dec8bb8be619a45b6f9746871bfc0e0ee8e2093: Status 404 returned error can't find the container with id e49ac47445c1ed51d78fa2f15dec8bb8be619a45b6f9746871bfc0e0ee8e2093
Jul 08 01:51:12.998855 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:12.998802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"]
Jul 08 01:51:13.002630 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:51:13.002605    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba4e908_55f5_4686_91ef_23ef4c019735.slice/crio-08f024fcbfa42e6ed82b287ed722fa6237e776ca7e5883196e61cafe018dcd9b WatchSource:0}: Error finding container 08f024fcbfa42e6ed82b287ed722fa6237e776ca7e5883196e61cafe018dcd9b: Status 404 returned error can't find the container with id 08f024fcbfa42e6ed82b287ed722fa6237e776ca7e5883196e61cafe018dcd9b
Jul 08 01:51:13.683307 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.683228    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:13.683307 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.683245    2582 scope.go:117] "RemoveContainer" containerID="e96f73ee5b94ab10c7a0f4ef8d330dee2d1baa24ba7163e2858bc33ba5ef00bc"
Jul 08 01:51:13.685187 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.685156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp" event={"ID":"4ba4e908-55f5-4686-91ef-23ef4c019735","Type":"ContainerStarted","Data":"d5cfdd63faf48092ffa93cfacf914f99149b75098fc0c2781206accd7ace5aed"}
Jul 08 01:51:13.685317 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.685215    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp" event={"ID":"4ba4e908-55f5-4686-91ef-23ef4c019735","Type":"ContainerStarted","Data":"08f024fcbfa42e6ed82b287ed722fa6237e776ca7e5883196e61cafe018dcd9b"}
Jul 08 01:51:13.685317 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.685246    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"
Jul 08 01:51:13.685928 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:13.685894    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:13.686944 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.686918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc" event={"ID":"52779a18-cc15-4bc5-af54-d3c89d5c4e69","Type":"ContainerStarted","Data":"eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166"}
Jul 08 01:51:13.687050 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.686970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:13.687050 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.686993    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc" event={"ID":"52779a18-cc15-4bc5-af54-d3c89d5c4e69","Type":"ContainerStarted","Data":"e49ac47445c1ed51d78fa2f15dec8bb8be619a45b6f9746871bfc0e0ee8e2093"}
Jul 08 01:51:13.688262 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:13.688084    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="da53b5a7-6cbd-4e02-a017-536326591616" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:13.688392 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.688377    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:13.690387 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:13.690362    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:13.695072 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.695052    2582 scope.go:117] "RemoveContainer" containerID="8300af7842e1c0509b290f360a9acd38b66805a18be50d28fd16fc1910b71e81"
Jul 08 01:51:13.718619 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.718564    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp" podStartSLOduration=1.718542875 podStartE2EDuration="1.718542875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:51:13.718514637 +0000 UTC m=+536.084348360" watchObservedRunningTime="2026-07-08 01:51:13.718542875 +0000 UTC m=+536.084376599"
Jul 08 01:51:13.749564 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:13.749512    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc" podStartSLOduration=1.749492025 podStartE2EDuration="1.749492025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:51:13.747532026 +0000 UTC m=+536.113365758" watchObservedRunningTime="2026-07-08 01:51:13.749492025 +0000 UTC m=+536.115325746"
Jul 08 01:51:13.749860 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:13.749828    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="da53b5a7-6cbd-4e02-a017-536326591616" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:13.752215 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:13.752188    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-p754t\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p754t"
Jul 08 01:51:13.754450 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:13.754426    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2l6m7\" is forbidden: User \"system:node:ip-10-0-138-104.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-104.ec2.internal' and this object" podUID="da53b5a7-6cbd-4e02-a017-536326591616" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2l6m7"
Jul 08 01:51:14.165605 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:14.165565    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b0e63ba-6d0a-4357-940a-f2ba3ce4e284" path="/var/lib/kubelet/pods/4b0e63ba-6d0a-4357-940a-f2ba3ce4e284/volumes"
Jul 08 01:51:14.166009 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:14.165989    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da53b5a7-6cbd-4e02-a017-536326591616" path="/var/lib/kubelet/pods/da53b5a7-6cbd-4e02-a017-536326591616/volumes"
Jul 08 01:51:14.168960 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:14.168936    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:14.265944 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:14.265910    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:14.720446 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:14.720417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:14.827934 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:14.827905    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:17.189545 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:17.189508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:17.290376 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:17.290343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:17.696220 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:17.696183    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:17.796443 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:17.796411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:22.291147 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:22.291111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:22.392310 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:22.392280    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:24.698136 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:24.698107    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:24.698518 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:24.698173    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5zjnp"
Jul 08 01:51:24.894985 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:24.894947    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:24.993238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:24.993143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:29.419853 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:29.419816    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"]
Jul 08 01:51:29.420298 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:29.420023    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc" podUID="52779a18-cc15-4bc5-af54-d3c89d5c4e69" containerName="manager" containerID="cri-o://eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166" gracePeriod=10
Jul 08 01:51:30.173609 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.173578    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:30.248155 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.248065    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcwbz\" (UniqueName: \"kubernetes.io/projected/52779a18-cc15-4bc5-af54-d3c89d5c4e69-kube-api-access-xcwbz\") pod \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\" (UID: \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\") "
Jul 08 01:51:30.248155 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.248152    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52779a18-cc15-4bc5-af54-d3c89d5c4e69-extensions-socket-volume\") pod \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\" (UID: \"52779a18-cc15-4bc5-af54-d3c89d5c4e69\") "
Jul 08 01:51:30.248590 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.248559    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52779a18-cc15-4bc5-af54-d3c89d5c4e69-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "52779a18-cc15-4bc5-af54-d3c89d5c4e69" (UID: "52779a18-cc15-4bc5-af54-d3c89d5c4e69"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 01:51:30.250228 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.250203    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52779a18-cc15-4bc5-af54-d3c89d5c4e69-kube-api-access-xcwbz" (OuterVolumeSpecName: "kube-api-access-xcwbz") pod "52779a18-cc15-4bc5-af54-d3c89d5c4e69" (UID: "52779a18-cc15-4bc5-af54-d3c89d5c4e69"). InnerVolumeSpecName "kube-api-access-xcwbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:51:30.349333 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.349298    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/52779a18-cc15-4bc5-af54-d3c89d5c4e69-extensions-socket-volume\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:51:30.349333 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.349326    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcwbz\" (UniqueName: \"kubernetes.io/projected/52779a18-cc15-4bc5-af54-d3c89d5c4e69-kube-api-access-xcwbz\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:51:30.770840 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.770805    2582 generic.go:356] "Generic (PLEG): container finished" podID="52779a18-cc15-4bc5-af54-d3c89d5c4e69" containerID="eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166" exitCode=0
Jul 08 01:51:30.771249 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.770851    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"
Jul 08 01:51:30.771249 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.770897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc" event={"ID":"52779a18-cc15-4bc5-af54-d3c89d5c4e69","Type":"ContainerDied","Data":"eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166"}
Jul 08 01:51:30.771249 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.770952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc" event={"ID":"52779a18-cc15-4bc5-af54-d3c89d5c4e69","Type":"ContainerDied","Data":"e49ac47445c1ed51d78fa2f15dec8bb8be619a45b6f9746871bfc0e0ee8e2093"}
Jul 08 01:51:30.771249 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.770979    2582 scope.go:117] "RemoveContainer" containerID="eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166"
Jul 08 01:51:30.779545 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.779528    2582 scope.go:117] "RemoveContainer" containerID="eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166"
Jul 08 01:51:30.779767 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:30.779750    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166\": container with ID starting with eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166 not found: ID does not exist" containerID="eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166"
Jul 08 01:51:30.779820 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.779776    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166"} err="failed to get container status \"eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166\": rpc error: code = NotFound desc = could not find container \"eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166\": container with ID starting with eeba30aa8a7913d5860f59253fe0c0c9eb7886e0096c58c794f1e2f996ac4166 not found: ID does not exist"
Jul 08 01:51:30.798979 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.798954    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"]
Jul 08 01:51:30.803687 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:30.803666    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k9whc"]
Jul 08 01:51:32.165218 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:32.165177    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52779a18-cc15-4bc5-af54-d3c89d5c4e69" path="/var/lib/kubelet/pods/52779a18-cc15-4bc5-af54-d3c89d5c4e69/volumes"
Jul 08 01:51:45.819613 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.819575    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"]
Jul 08 01:51:45.820100 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.819948    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52779a18-cc15-4bc5-af54-d3c89d5c4e69" containerName="manager"
Jul 08 01:51:45.820100 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.819961    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="52779a18-cc15-4bc5-af54-d3c89d5c4e69" containerName="manager"
Jul 08 01:51:45.820100 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.820016    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="52779a18-cc15-4bc5-af54-d3c89d5c4e69" containerName="manager"
Jul 08 01:51:45.823038 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.823014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.826048 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.826025    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 01:51:45.826197 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.826127    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-f7kgk\""
Jul 08 01:51:45.839646 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.839607    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"]
Jul 08 01:51:45.854418 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.854374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:45.951446 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.951397    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:45.980507 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.980669 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.980669 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.980669 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980585    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.980669 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.980669 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.980864 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.980864 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw87n\" (UniqueName: \"kubernetes.io/projected/9f14c1af-ba7b-488f-b32f-7569d3ab8268-kube-api-access-fw87n\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:45.980864 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:45.980791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.081773 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.081666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.081773 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.081735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.081773 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.081775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082019 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.081802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082019 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.081867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw87n\" (UniqueName: \"kubernetes.io/projected/9f14c1af-ba7b-488f-b32f-7569d3ab8268-kube-api-access-fw87n\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082019 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.081912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082019 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.081937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082019 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.081973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082019 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.082000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082297 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.082214    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082350 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.082328    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082404 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.082356    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082558 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.082528    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.082883 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.082856    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.084055 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.084035    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.084314 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.084295    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.090865 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.090838    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw87n\" (UniqueName: \"kubernetes.io/projected/9f14c1af-ba7b-488f-b32f-7569d3ab8268-kube-api-access-fw87n\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.090865 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.090844    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f14c1af-ba7b-488f-b32f-7569d3ab8268-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-cjq7c\" (UID: \"9f14c1af-ba7b-488f-b32f-7569d3ab8268\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.134756 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.134695    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:46.271967 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.271939    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"]
Jul 08 01:51:46.273386 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:51:46.273361    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f14c1af_ba7b_488f_b32f_7569d3ab8268.slice/crio-b95d57bfc58d07fa3be13961bacf32eaf9cb8cf225c019fb5967a9f0f52128c2 WatchSource:0}: Error finding container b95d57bfc58d07fa3be13961bacf32eaf9cb8cf225c019fb5967a9f0f52128c2: Status 404 returned error can't find the container with id b95d57bfc58d07fa3be13961bacf32eaf9cb8cf225c019fb5967a9f0f52128c2
Jul 08 01:51:46.854253 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:46.854215    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" event={"ID":"9f14c1af-ba7b-488f-b32f-7569d3ab8268","Type":"ContainerStarted","Data":"b95d57bfc58d07fa3be13961bacf32eaf9cb8cf225c019fb5967a9f0f52128c2"}
Jul 08 01:51:48.269156 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:48.269100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:48.987958 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:48.987919    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 01:51:48.988087 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:48.988007    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 01:51:48.988087 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:48.988053    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 01:51:49.871746 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:49.871684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" event={"ID":"9f14c1af-ba7b-488f-b32f-7569d3ab8268","Type":"ContainerStarted","Data":"e09754ab096b05fc20f74898d175be0934776f3bbe17a2f7620d810e31a73a21"}
Jul 08 01:51:49.899353 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:49.899300    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" podStartSLOduration=2.186973058 podStartE2EDuration="4.89928302s" totalImagesPullingTime="2.712309962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:51:49.89751977 +0000 UTC m=+572.263353493" watchObservedRunningTime="2026-07-08 01:51:49.89928302 +0000 UTC m=+572.265116822"
Jul 08 01:51:50.135139 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.135051    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:50.139948 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.139920    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:50.877135 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.877090    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:50.878201 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.878180    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:51:50.906261 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.906215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:50.923279 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.923245    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-48pqv"]
Jul 08 01:51:50.926919 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.926899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:50.929995 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.929970    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 01:51:50.930106 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.929970    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-27b8d\""
Jul 08 01:51:50.939456 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:50.939426    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-48pqv"]
Jul 08 01:51:51.007856 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.007817    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-48pqv"]
Jul 08 01:51:51.011555 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.011528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:51.017804 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.017778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/082937bf-414b-4764-b170-393ba13af08c-config-file\") pod \"limitador-limitador-64c94fd64f-48pqv\" (UID: \"082937bf-414b-4764-b170-393ba13af08c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:51.017919 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.017839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kcf9\" (UniqueName: \"kubernetes.io/projected/082937bf-414b-4764-b170-393ba13af08c-kube-api-access-7kcf9\") pod \"limitador-limitador-64c94fd64f-48pqv\" (UID: \"082937bf-414b-4764-b170-393ba13af08c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:51.119098 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.119061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kcf9\" (UniqueName: \"kubernetes.io/projected/082937bf-414b-4764-b170-393ba13af08c-kube-api-access-7kcf9\") pod \"limitador-limitador-64c94fd64f-48pqv\" (UID: \"082937bf-414b-4764-b170-393ba13af08c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:51.119285 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.119147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/082937bf-414b-4764-b170-393ba13af08c-config-file\") pod \"limitador-limitador-64c94fd64f-48pqv\" (UID: \"082937bf-414b-4764-b170-393ba13af08c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:51.119922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.119899    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/082937bf-414b-4764-b170-393ba13af08c-config-file\") pod \"limitador-limitador-64c94fd64f-48pqv\" (UID: \"082937bf-414b-4764-b170-393ba13af08c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:51.126084 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.126061    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:51.131586 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.131533    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kcf9\" (UniqueName: \"kubernetes.io/projected/082937bf-414b-4764-b170-393ba13af08c-kube-api-access-7kcf9\") pod \"limitador-limitador-64c94fd64f-48pqv\" (UID: \"082937bf-414b-4764-b170-393ba13af08c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:51.238317 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.238276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:51.380396 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.380351    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-48pqv"]
Jul 08 01:51:51.383897 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:51:51.383869    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082937bf_414b_4764_b170_393ba13af08c.slice/crio-a6f1d9b58bdf884bf90defc2a8dd2f69c6385667ddb88eba0a54e2ec1c8bac84 WatchSource:0}: Error finding container a6f1d9b58bdf884bf90defc2a8dd2f69c6385667ddb88eba0a54e2ec1c8bac84: Status 404 returned error can't find the container with id a6f1d9b58bdf884bf90defc2a8dd2f69c6385667ddb88eba0a54e2ec1c8bac84
Jul 08 01:51:51.774991 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.774947    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-d4xbt"]
Jul 08 01:51:51.779804 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.779780    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d4xbt"
Jul 08 01:51:51.783749 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.783715    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-57448\""
Jul 08 01:51:51.785886 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.785861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-d4xbt"]
Jul 08 01:51:51.815521 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.815489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:51.825865 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.825840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52wcj\" (UniqueName: \"kubernetes.io/projected/ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6-kube-api-access-52wcj\") pod \"authorino-58cd955675-d4xbt\" (UID: \"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6\") " pod="kuadrant-system/authorino-58cd955675-d4xbt"
Jul 08 01:51:51.886512 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.886479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv" event={"ID":"082937bf-414b-4764-b170-393ba13af08c","Type":"ContainerStarted","Data":"a6f1d9b58bdf884bf90defc2a8dd2f69c6385667ddb88eba0a54e2ec1c8bac84"}
Jul 08 01:51:51.892311 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.892287    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:51:51.926848 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.926744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52wcj\" (UniqueName: \"kubernetes.io/projected/ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6-kube-api-access-52wcj\") pod \"authorino-58cd955675-d4xbt\" (UID: \"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6\") " pod="kuadrant-system/authorino-58cd955675-d4xbt"
Jul 08 01:51:51.935989 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:51.935958    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52wcj\" (UniqueName: \"kubernetes.io/projected/ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6-kube-api-access-52wcj\") pod \"authorino-58cd955675-d4xbt\" (UID: \"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6\") " pod="kuadrant-system/authorino-58cd955675-d4xbt"
Jul 08 01:51:52.090924 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:52.090844    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d4xbt"
Jul 08 01:51:52.304822 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:52.304791    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-d4xbt"]
Jul 08 01:51:52.893167 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:52.893126    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d4xbt" event={"ID":"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6","Type":"ContainerStarted","Data":"ef2f145843ea8145c13a5e3c0c0b4567d53e1c2ebaf228355a558523f09ee3d8"}
Jul 08 01:51:54.907562 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:54.907508    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv" event={"ID":"082937bf-414b-4764-b170-393ba13af08c","Type":"ContainerStarted","Data":"1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a"}
Jul 08 01:51:54.908000 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:54.907732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:51:54.926933 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:54.926882    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv" podStartSLOduration=2.167666705 podStartE2EDuration="4.926864511s" totalImagesPullingTime="2.759197806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:51:54.924792375 +0000 UTC m=+577.290626098" watchObservedRunningTime="2026-07-08 01:51:54.926864511 +0000 UTC m=+577.292698233"
Jul 08 01:51:56.920104 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:56.920003    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d4xbt" event={"ID":"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6","Type":"ContainerStarted","Data":"63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86"}
Jul 08 01:51:56.939914 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:56.939863    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-d4xbt" podStartSLOduration=1.658651224 podStartE2EDuration="5.939848705s" totalImagesPullingTime="4.281197481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:51:56.938516667 +0000 UTC m=+579.304350391" watchObservedRunningTime="2026-07-08 01:51:56.939848705 +0000 UTC m=+579.305682440"
Jul 08 01:51:57.298174 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:57.298142    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-d4xbt"]
Jul 08 01:51:58.929914 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:58.929849    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-d4xbt" podUID="ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6" containerName="authorino" containerID="cri-o://63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86" gracePeriod=30
Jul 08 01:51:59.188285 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.188259    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d4xbt"
Jul 08 01:51:59.293155 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.293113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52wcj\" (UniqueName: \"kubernetes.io/projected/ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6-kube-api-access-52wcj\") pod \"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6\" (UID: \"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6\") "
Jul 08 01:51:59.295186 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.295155    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6-kube-api-access-52wcj" (OuterVolumeSpecName: "kube-api-access-52wcj") pod "ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6" (UID: "ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6"). InnerVolumeSpecName "kube-api-access-52wcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:51:59.394262 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.394226    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52wcj\" (UniqueName: \"kubernetes.io/projected/ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6-kube-api-access-52wcj\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:51:59.936033 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.935994    2582 generic.go:356] "Generic (PLEG): container finished" podID="ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6" containerID="63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86" exitCode=0
Jul 08 01:51:59.936033 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.936036    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d4xbt"
Jul 08 01:51:59.936541 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.936081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d4xbt" event={"ID":"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6","Type":"ContainerDied","Data":"63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86"}
Jul 08 01:51:59.936541 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.936118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d4xbt" event={"ID":"ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6","Type":"ContainerDied","Data":"ef2f145843ea8145c13a5e3c0c0b4567d53e1c2ebaf228355a558523f09ee3d8"}
Jul 08 01:51:59.936541 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.936135    2582 scope.go:117] "RemoveContainer" containerID="63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86"
Jul 08 01:51:59.945184 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.945164    2582 scope.go:117] "RemoveContainer" containerID="63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86"
Jul 08 01:51:59.945475 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:51:59.945455    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86\": container with ID starting with 63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86 not found: ID does not exist" containerID="63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86"
Jul 08 01:51:59.945537 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.945484    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86"} err="failed to get container status \"63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86\": rpc error: code = NotFound desc = could not find container \"63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86\": container with ID starting with 63ad4715314ed72a8d7d64d3ecd8e0e6bee62b5acb63c1cd8bb5c83bfcf8df86 not found: ID does not exist"
Jul 08 01:51:59.957764 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.957734    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-d4xbt"]
Jul 08 01:51:59.962502 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:51:59.962476    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-d4xbt"]
Jul 08 01:52:00.165246 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:00.165208    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6" path="/var/lib/kubelet/pods/ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6/volumes"
Jul 08 01:52:05.914497 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:05.914463    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:52:06.304187 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.304148    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-48pqv"]
Jul 08 01:52:06.304390 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.304327    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv" podUID="082937bf-414b-4764-b170-393ba13af08c" containerName="limitador" containerID="cri-o://1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a" gracePeriod=30
Jul 08 01:52:06.857863 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.857832    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:52:06.962623 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.962576    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kcf9\" (UniqueName: \"kubernetes.io/projected/082937bf-414b-4764-b170-393ba13af08c-kube-api-access-7kcf9\") pod \"082937bf-414b-4764-b170-393ba13af08c\" (UID: \"082937bf-414b-4764-b170-393ba13af08c\") "
Jul 08 01:52:06.963100 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.962658    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/082937bf-414b-4764-b170-393ba13af08c-config-file\") pod \"082937bf-414b-4764-b170-393ba13af08c\" (UID: \"082937bf-414b-4764-b170-393ba13af08c\") "
Jul 08 01:52:06.963100 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.963002    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/082937bf-414b-4764-b170-393ba13af08c-config-file" (OuterVolumeSpecName: "config-file") pod "082937bf-414b-4764-b170-393ba13af08c" (UID: "082937bf-414b-4764-b170-393ba13af08c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 01:52:06.964839 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.964808    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/082937bf-414b-4764-b170-393ba13af08c-kube-api-access-7kcf9" (OuterVolumeSpecName: "kube-api-access-7kcf9") pod "082937bf-414b-4764-b170-393ba13af08c" (UID: "082937bf-414b-4764-b170-393ba13af08c"). InnerVolumeSpecName "kube-api-access-7kcf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:52:06.969330 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.969307    2582 generic.go:356] "Generic (PLEG): container finished" podID="082937bf-414b-4764-b170-393ba13af08c" containerID="1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a" exitCode=0
Jul 08 01:52:06.969422 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.969367    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv"
Jul 08 01:52:06.969422 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.969385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv" event={"ID":"082937bf-414b-4764-b170-393ba13af08c","Type":"ContainerDied","Data":"1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a"}
Jul 08 01:52:06.969498 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.969472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-48pqv" event={"ID":"082937bf-414b-4764-b170-393ba13af08c","Type":"ContainerDied","Data":"a6f1d9b58bdf884bf90defc2a8dd2f69c6385667ddb88eba0a54e2ec1c8bac84"}
Jul 08 01:52:06.969534 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.969501    2582 scope.go:117] "RemoveContainer" containerID="1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a"
Jul 08 01:52:06.978361 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.978344    2582 scope.go:117] "RemoveContainer" containerID="1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a"
Jul 08 01:52:06.978646 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:52:06.978627    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a\": container with ID starting with 1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a not found: ID does not exist" containerID="1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a"
Jul 08 01:52:06.978716 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.978654    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a"} err="failed to get container status \"1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a\": rpc error: code = NotFound desc = could not find container \"1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a\": container with ID starting with 1c27ff638cc541c824e310db480ac8ab1344b54ba6db4393c542ebf95b08d22a not found: ID does not exist"
Jul 08 01:52:06.991541 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.991518    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-48pqv"]
Jul 08 01:52:06.999602 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:06.999578    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-48pqv"]
Jul 08 01:52:07.063656 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:07.063609    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kcf9\" (UniqueName: \"kubernetes.io/projected/082937bf-414b-4764-b170-393ba13af08c-kube-api-access-7kcf9\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:52:07.063656 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:07.063650    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/082937bf-414b-4764-b170-393ba13af08c-config-file\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:52:08.164807 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:08.164774    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="082937bf-414b-4764-b170-393ba13af08c" path="/var/lib/kubelet/pods/082937bf-414b-4764-b170-393ba13af08c/volumes"
Jul 08 01:52:12.203222 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.203184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:12.305016 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.304975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:12.677742 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.677640    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"]
Jul 08 01:52:12.678034 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.678021    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6" containerName="authorino"
Jul 08 01:52:12.678076 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.678036    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6" containerName="authorino"
Jul 08 01:52:12.678076 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.678058    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="082937bf-414b-4764-b170-393ba13af08c" containerName="limitador"
Jul 08 01:52:12.678076 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.678064    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="082937bf-414b-4764-b170-393ba13af08c" containerName="limitador"
Jul 08 01:52:12.678165 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.678118    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="082937bf-414b-4764-b170-393ba13af08c" containerName="limitador"
Jul 08 01:52:12.678165 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.678127    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad9a8836-39ab-4a0d-b186-1e07fcfaa4f6" containerName="authorino"
Jul 08 01:52:12.680986 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.680964    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:12.683773 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.683731    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 01:52:12.685061 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.685039    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 01:52:12.685061 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.685050    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-24vhq\""
Jul 08 01:52:12.685228 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.685050    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 01:52:12.691802 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.691777    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"]
Jul 08 01:52:12.720013 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.719946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:12.821754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.821694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/15104cf0-0f20-42d2-8183-ccb98ca9660c-data\") pod \"postgres-69fb4594cf-c92vg\" (UID: \"15104cf0-0f20-42d2-8183-ccb98ca9660c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:12.821754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.821749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85q95\" (UniqueName: \"kubernetes.io/projected/15104cf0-0f20-42d2-8183-ccb98ca9660c-kube-api-access-85q95\") pod \"postgres-69fb4594cf-c92vg\" (UID: \"15104cf0-0f20-42d2-8183-ccb98ca9660c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:12.922433 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.922397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/15104cf0-0f20-42d2-8183-ccb98ca9660c-data\") pod \"postgres-69fb4594cf-c92vg\" (UID: \"15104cf0-0f20-42d2-8183-ccb98ca9660c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:12.922433 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.922432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85q95\" (UniqueName: \"kubernetes.io/projected/15104cf0-0f20-42d2-8183-ccb98ca9660c-kube-api-access-85q95\") pod \"postgres-69fb4594cf-c92vg\" (UID: \"15104cf0-0f20-42d2-8183-ccb98ca9660c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:12.922883 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.922858    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/15104cf0-0f20-42d2-8183-ccb98ca9660c-data\") pod \"postgres-69fb4594cf-c92vg\" (UID: \"15104cf0-0f20-42d2-8183-ccb98ca9660c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:12.932400 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.932338    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85q95\" (UniqueName: \"kubernetes.io/projected/15104cf0-0f20-42d2-8183-ccb98ca9660c-kube-api-access-85q95\") pod \"postgres-69fb4594cf-c92vg\" (UID: \"15104cf0-0f20-42d2-8183-ccb98ca9660c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:12.992485 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:12.992457    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:13.126949 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:13.126909    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"]
Jul 08 01:52:13.129789 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:52:13.129763    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15104cf0_0f20_42d2_8183_ccb98ca9660c.slice/crio-eecfa2d0cf50fa0e67400103c4975a2b37f1a01775f25242bdf4411b00678cdb WatchSource:0}: Error finding container eecfa2d0cf50fa0e67400103c4975a2b37f1a01775f25242bdf4411b00678cdb: Status 404 returned error can't find the container with id eecfa2d0cf50fa0e67400103c4975a2b37f1a01775f25242bdf4411b00678cdb
Jul 08 01:52:14.009800 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:14.009682    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg" event={"ID":"15104cf0-0f20-42d2-8183-ccb98ca9660c","Type":"ContainerStarted","Data":"eecfa2d0cf50fa0e67400103c4975a2b37f1a01775f25242bdf4411b00678cdb"}
Jul 08 01:52:18.031349 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:18.031255    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg" event={"ID":"15104cf0-0f20-42d2-8183-ccb98ca9660c","Type":"ContainerStarted","Data":"7c3ef89a221a00872fc24832684d664728e5dd33f37d252da01ef6b06e2705f3"}
Jul 08 01:52:18.031766 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:18.031435    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:18.050149 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:18.050092    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg" podStartSLOduration=1.403203239 podStartE2EDuration="6.050076781s" totalImagesPullingTime="4.646873542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:52:18.048478205 +0000 UTC m=+600.414311927" watchObservedRunningTime="2026-07-08 01:52:18.050076781 +0000 UTC m=+600.415910552"
Jul 08 01:52:18.104917 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:18.104877    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 01:52:18.105285 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:18.105262    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 01:52:24.066335 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:24.066296    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c92vg"
Jul 08 01:52:24.424515 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:24.424433    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:24.890901 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:24.890862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:31.009823 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.009787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:31.032642 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.032605    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bc4997db8-gzqx7"]
Jul 08 01:52:31.039892 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.039867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.042659 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.042635    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 01:52:31.042860 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.042844    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r46wg\""
Jul 08 01:52:31.042923 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.042859    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 01:52:31.046920 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.046897    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bc4997db8-gzqx7"]
Jul 08 01:52:31.091403 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.091350    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:31.185071 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.185036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmhgl\" (UniqueName: \"kubernetes.io/projected/f3d807cb-8a46-499c-b65a-92c34cd8ab09-kube-api-access-cmhgl\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.185264 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.185083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d807cb-8a46-499c-b65a-92c34cd8ab09-service-ca\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.185264 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.185120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3d807cb-8a46-499c-b65a-92c34cd8ab09-webhook-cert\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.193504 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.193474    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:31.204895 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.204870    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-764c6698d4-b9gpg"]
Jul 08 01:52:31.207240 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.207221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.221128 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.221103    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-764c6698d4-b9gpg"]
Jul 08 01:52:31.266837 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.266688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:31.286495 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.286450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmhgl\" (UniqueName: \"kubernetes.io/projected/f3d807cb-8a46-499c-b65a-92c34cd8ab09-kube-api-access-cmhgl\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.286495 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.286508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d807cb-8a46-499c-b65a-92c34cd8ab09-service-ca\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.286740 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.286545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3d807cb-8a46-499c-b65a-92c34cd8ab09-webhook-cert\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.287211 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.287189    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d807cb-8a46-499c-b65a-92c34cd8ab09-service-ca\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.288905 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.288886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3d807cb-8a46-499c-b65a-92c34cd8ab09-webhook-cert\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.294866 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.294844    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmhgl\" (UniqueName: \"kubernetes.io/projected/f3d807cb-8a46-499c-b65a-92c34cd8ab09-kube-api-access-cmhgl\") pod \"maas-controller-5bc4997db8-gzqx7\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") " pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.353802 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.353772    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:31.387091 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.387056    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06201c7d-170f-4af2-9475-1d99a5fbb59e-webhook-cert\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.387231 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.387099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz94w\" (UniqueName: \"kubernetes.io/projected/06201c7d-170f-4af2-9475-1d99a5fbb59e-kube-api-access-zz94w\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.387231 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.387133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06201c7d-170f-4af2-9475-1d99a5fbb59e-service-ca\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.488607 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.488569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06201c7d-170f-4af2-9475-1d99a5fbb59e-webhook-cert\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.488786 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.488616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz94w\" (UniqueName: \"kubernetes.io/projected/06201c7d-170f-4af2-9475-1d99a5fbb59e-kube-api-access-zz94w\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.488786 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.488661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06201c7d-170f-4af2-9475-1d99a5fbb59e-service-ca\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.489353 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.489335    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06201c7d-170f-4af2-9475-1d99a5fbb59e-service-ca\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.491268 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.491241    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06201c7d-170f-4af2-9475-1d99a5fbb59e-webhook-cert\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.493774 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.493755    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bc4997db8-gzqx7"]
Jul 08 01:52:31.495721 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:52:31.495685    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d807cb_8a46_499c_b65a_92c34cd8ab09.slice/crio-8e307753977c1eabca02b16660083f9ed88b43e6bf6a88825d23b011b3bb5b29 WatchSource:0}: Error finding container 8e307753977c1eabca02b16660083f9ed88b43e6bf6a88825d23b011b3bb5b29: Status 404 returned error can't find the container with id 8e307753977c1eabca02b16660083f9ed88b43e6bf6a88825d23b011b3bb5b29
Jul 08 01:52:31.497611 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.497589    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz94w\" (UniqueName: \"kubernetes.io/projected/06201c7d-170f-4af2-9475-1d99a5fbb59e-kube-api-access-zz94w\") pod \"maas-controller-764c6698d4-b9gpg\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") " pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.516533 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.516513    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:31.648289 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:31.648262    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-764c6698d4-b9gpg"]
Jul 08 01:52:31.649470 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:52:31.649439    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06201c7d_170f_4af2_9475_1d99a5fbb59e.slice/crio-db9432f74733a0ba92b1b657ec8b75e3b50731bab1beae262e30e0a05a01c931 WatchSource:0}: Error finding container db9432f74733a0ba92b1b657ec8b75e3b50731bab1beae262e30e0a05a01c931: Status 404 returned error can't find the container with id db9432f74733a0ba92b1b657ec8b75e3b50731bab1beae262e30e0a05a01c931
Jul 08 01:52:32.097752 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:32.097696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bc4997db8-gzqx7" event={"ID":"f3d807cb-8a46-499c-b65a-92c34cd8ab09","Type":"ContainerStarted","Data":"8e307753977c1eabca02b16660083f9ed88b43e6bf6a88825d23b011b3bb5b29"}
Jul 08 01:52:32.099172 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:32.099129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-764c6698d4-b9gpg" event={"ID":"06201c7d-170f-4af2-9475-1d99a5fbb59e","Type":"ContainerStarted","Data":"db9432f74733a0ba92b1b657ec8b75e3b50731bab1beae262e30e0a05a01c931"}
Jul 08 01:52:34.324121 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:34.324086    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:34.415613 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:34.415528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:52:35.117343 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:35.117304    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bc4997db8-gzqx7" event={"ID":"f3d807cb-8a46-499c-b65a-92c34cd8ab09","Type":"ContainerStarted","Data":"e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be"}
Jul 08 01:52:35.117558 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:35.117501    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:35.118838 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:35.118817    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-764c6698d4-b9gpg" event={"ID":"06201c7d-170f-4af2-9475-1d99a5fbb59e","Type":"ContainerStarted","Data":"93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919"}
Jul 08 01:52:35.118946 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:35.118875    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:35.137103 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:35.137051    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bc4997db8-gzqx7" podStartSLOduration=1.533962072 podStartE2EDuration="4.137035s" totalImagesPullingTime="2.603072928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:52:35.135528023 +0000 UTC m=+617.501361746" watchObservedRunningTime="2026-07-08 01:52:35.137035 +0000 UTC m=+617.502868735"
Jul 08 01:52:35.152334 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:35.152270    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-764c6698d4-b9gpg" podStartSLOduration=1.697890332 podStartE2EDuration="4.152250891s" totalImagesPullingTime="2.454360559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:52:35.152117526 +0000 UTC m=+617.517951250" watchObservedRunningTime="2026-07-08 01:52:35.152250891 +0000 UTC m=+617.518084614"
Jul 08 01:52:46.130114 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.130082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:52:46.132575 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.130395    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:46.194438 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.194406    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bc4997db8-gzqx7"]
Jul 08 01:52:46.194671 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.194608    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5bc4997db8-gzqx7" podUID="f3d807cb-8a46-499c-b65a-92c34cd8ab09" containerName="manager" containerID="cri-o://e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be" gracePeriod=30
Jul 08 01:52:46.441988 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.441963    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:46.523375 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.523340    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d807cb-8a46-499c-b65a-92c34cd8ab09-service-ca\") pod \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") "
Jul 08 01:52:46.523549 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.523408    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmhgl\" (UniqueName: \"kubernetes.io/projected/f3d807cb-8a46-499c-b65a-92c34cd8ab09-kube-api-access-cmhgl\") pod \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") "
Jul 08 01:52:46.523549 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.523439    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3d807cb-8a46-499c-b65a-92c34cd8ab09-webhook-cert\") pod \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\" (UID: \"f3d807cb-8a46-499c-b65a-92c34cd8ab09\") "
Jul 08 01:52:46.523821 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.523794    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3d807cb-8a46-499c-b65a-92c34cd8ab09-service-ca" (OuterVolumeSpecName: "service-ca") pod "f3d807cb-8a46-499c-b65a-92c34cd8ab09" (UID: "f3d807cb-8a46-499c-b65a-92c34cd8ab09"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 01:52:46.525796 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.525766    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3d807cb-8a46-499c-b65a-92c34cd8ab09-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f3d807cb-8a46-499c-b65a-92c34cd8ab09" (UID: "f3d807cb-8a46-499c-b65a-92c34cd8ab09"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 01:52:46.525896 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.525803    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d807cb-8a46-499c-b65a-92c34cd8ab09-kube-api-access-cmhgl" (OuterVolumeSpecName: "kube-api-access-cmhgl") pod "f3d807cb-8a46-499c-b65a-92c34cd8ab09" (UID: "f3d807cb-8a46-499c-b65a-92c34cd8ab09"). InnerVolumeSpecName "kube-api-access-cmhgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:52:46.624497 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.624460    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3d807cb-8a46-499c-b65a-92c34cd8ab09-webhook-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:52:46.624497 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.624486    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3d807cb-8a46-499c-b65a-92c34cd8ab09-service-ca\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:52:46.624497 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:46.624499    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmhgl\" (UniqueName: \"kubernetes.io/projected/f3d807cb-8a46-499c-b65a-92c34cd8ab09-kube-api-access-cmhgl\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:52:47.179494 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.179459    2582 generic.go:356] "Generic (PLEG): container finished" podID="f3d807cb-8a46-499c-b65a-92c34cd8ab09" containerID="e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be" exitCode=0
Jul 08 01:52:47.179987 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.179502    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bc4997db8-gzqx7"
Jul 08 01:52:47.179987 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.179555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bc4997db8-gzqx7" event={"ID":"f3d807cb-8a46-499c-b65a-92c34cd8ab09","Type":"ContainerDied","Data":"e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be"}
Jul 08 01:52:47.179987 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.179617    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bc4997db8-gzqx7" event={"ID":"f3d807cb-8a46-499c-b65a-92c34cd8ab09","Type":"ContainerDied","Data":"8e307753977c1eabca02b16660083f9ed88b43e6bf6a88825d23b011b3bb5b29"}
Jul 08 01:52:47.179987 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.179652    2582 scope.go:117] "RemoveContainer" containerID="e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be"
Jul 08 01:52:47.188806 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.188787    2582 scope.go:117] "RemoveContainer" containerID="e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be"
Jul 08 01:52:47.189104 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:52:47.189084    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be\": container with ID starting with e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be not found: ID does not exist" containerID="e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be"
Jul 08 01:52:47.189151 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.189113    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be"} err="failed to get container status \"e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be\": rpc error: code = NotFound desc = could not find container \"e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be\": container with ID starting with e17f1efcb3e71623981103601e70019e2a7b740ef797c108c412eb20c34311be not found: ID does not exist"
Jul 08 01:52:47.202129 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.202106    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bc4997db8-gzqx7"]
Jul 08 01:52:47.203729 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:47.203695    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bc4997db8-gzqx7"]
Jul 08 01:52:48.166817 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:52:48.166785    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d807cb-8a46-499c-b65a-92c34cd8ab09" path="/var/lib/kubelet/pods/f3d807cb-8a46-499c-b65a-92c34cd8ab09/volumes"
Jul 08 01:53:06.869625 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:06.869588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:07.349296 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.349264    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:07.438219 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.438185    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"]
Jul 08 01:53:07.438588 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.438575    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d807cb-8a46-499c-b65a-92c34cd8ab09" containerName="manager"
Jul 08 01:53:07.438632 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.438590    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d807cb-8a46-499c-b65a-92c34cd8ab09" containerName="manager"
Jul 08 01:53:07.438671 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.438645    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d807cb-8a46-499c-b65a-92c34cd8ab09" containerName="manager"
Jul 08 01:53:07.459754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.459720    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"]
Jul 08 01:53:07.459924 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.459806    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.462816 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.462789    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 01:53:07.462976 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.462914    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7bwwv\""
Jul 08 01:53:07.622928 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.622837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-maas-api-tls\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.623078 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.622937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbnrp\" (UniqueName: \"kubernetes.io/projected/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-kube-api-access-rbnrp\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.623078 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.622988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-openshift-service-ca\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.665506 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.665477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:07.723828 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.723797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-maas-api-tls\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.724010 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.723948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbnrp\" (UniqueName: \"kubernetes.io/projected/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-kube-api-access-rbnrp\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.724010 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.723983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-openshift-service-ca\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.724635 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.724614    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-openshift-service-ca\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.726238 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.726215    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-maas-api-tls\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.732806 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.732784    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbnrp\" (UniqueName: \"kubernetes.io/projected/fb2d6066-b7a2-4f26-b323-9d9cdf6ba409-kube-api-access-rbnrp\") pod \"maas-api-6f969cb5c6-jmd9m\" (UID: \"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409\") " pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.770674 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.770647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:07.836347 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.836306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:07.925784 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.925758    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"]
Jul 08 01:53:07.928296 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:53:07.928267    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2d6066_b7a2_4f26_b323_9d9cdf6ba409.slice/crio-c7111a404ac2bc108bb6de04f102ab8b126e638803318b3003f36018493d4a3e WatchSource:0}: Error finding container c7111a404ac2bc108bb6de04f102ab8b126e638803318b3003f36018493d4a3e: Status 404 returned error can't find the container with id c7111a404ac2bc108bb6de04f102ab8b126e638803318b3003f36018493d4a3e
Jul 08 01:53:07.928456 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.928351    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:07.947155 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.947129    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g7kb2"]
Jul 08 01:53:07.952172 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.952153    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:07.956009 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.955989    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 01:53:07.956118 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.955994    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rkjlq\""
Jul 08 01:53:07.965922 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.965899    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g7kb2"]
Jul 08 01:53:07.972239 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.972212    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zqmqr"]
Jul 08 01:53:07.975748 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.975700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:07.987269 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:07.987244    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zqmqr"]
Jul 08 01:53:08.127737 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.127687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a488b61-01d3-411a-9a17-a55dd52eb600-plugins-config-volume\") pod \"payload-processing-58f86c7798-zqmqr\" (UID: \"2a488b61-01d3-411a-9a17-a55dd52eb600\") " pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:08.127935 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.127801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js96w\" (UniqueName: \"kubernetes.io/projected/2a488b61-01d3-411a-9a17-a55dd52eb600-kube-api-access-js96w\") pod \"payload-processing-58f86c7798-zqmqr\" (UID: \"2a488b61-01d3-411a-9a17-a55dd52eb600\") " pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:08.127935 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.127835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/943cf9b3-dd7b-411c-bbcb-d41a13093709-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g7kb2\" (UID: \"943cf9b3-dd7b-411c-bbcb-d41a13093709\") " pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:08.127935 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.127902    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mvbn\" (UniqueName: \"kubernetes.io/projected/943cf9b3-dd7b-411c-bbcb-d41a13093709-kube-api-access-7mvbn\") pod \"payload-pre-processing-7964457696-g7kb2\" (UID: \"943cf9b3-dd7b-411c-bbcb-d41a13093709\") " pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:08.229091 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.229048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/943cf9b3-dd7b-411c-bbcb-d41a13093709-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g7kb2\" (UID: \"943cf9b3-dd7b-411c-bbcb-d41a13093709\") " pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:08.229295 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.229101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mvbn\" (UniqueName: \"kubernetes.io/projected/943cf9b3-dd7b-411c-bbcb-d41a13093709-kube-api-access-7mvbn\") pod \"payload-pre-processing-7964457696-g7kb2\" (UID: \"943cf9b3-dd7b-411c-bbcb-d41a13093709\") " pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:08.229295 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.229156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a488b61-01d3-411a-9a17-a55dd52eb600-plugins-config-volume\") pod \"payload-processing-58f86c7798-zqmqr\" (UID: \"2a488b61-01d3-411a-9a17-a55dd52eb600\") " pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:08.229406 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.229383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js96w\" (UniqueName: \"kubernetes.io/projected/2a488b61-01d3-411a-9a17-a55dd52eb600-kube-api-access-js96w\") pod \"payload-processing-58f86c7798-zqmqr\" (UID: \"2a488b61-01d3-411a-9a17-a55dd52eb600\") " pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:08.229902 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.229883    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a488b61-01d3-411a-9a17-a55dd52eb600-plugins-config-volume\") pod \"payload-processing-58f86c7798-zqmqr\" (UID: \"2a488b61-01d3-411a-9a17-a55dd52eb600\") " pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:08.229954 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.229905    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/943cf9b3-dd7b-411c-bbcb-d41a13093709-plugins-config-volume\") pod \"payload-pre-processing-7964457696-g7kb2\" (UID: \"943cf9b3-dd7b-411c-bbcb-d41a13093709\") " pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:08.238602 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.238574    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js96w\" (UniqueName: \"kubernetes.io/projected/2a488b61-01d3-411a-9a17-a55dd52eb600-kube-api-access-js96w\") pod \"payload-processing-58f86c7798-zqmqr\" (UID: \"2a488b61-01d3-411a-9a17-a55dd52eb600\") " pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:08.238754 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.238604    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mvbn\" (UniqueName: \"kubernetes.io/projected/943cf9b3-dd7b-411c-bbcb-d41a13093709-kube-api-access-7mvbn\") pod \"payload-pre-processing-7964457696-g7kb2\" (UID: \"943cf9b3-dd7b-411c-bbcb-d41a13093709\") " pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:08.262623 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.262586    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:08.287380 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.287319    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:08.289807 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.289768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m" event={"ID":"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409","Type":"ContainerStarted","Data":"c7111a404ac2bc108bb6de04f102ab8b126e638803318b3003f36018493d4a3e"}
Jul 08 01:53:08.426122 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.426081    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-g7kb2"]
Jul 08 01:53:08.428430 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:53:08.428382    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943cf9b3_dd7b_411c_bbcb_d41a13093709.slice/crio-d8fd6cb4c120f29b3f4741dc641464b90b3b0e528dcc66b6bdf2f953ac670990 WatchSource:0}: Error finding container d8fd6cb4c120f29b3f4741dc641464b90b3b0e528dcc66b6bdf2f953ac670990: Status 404 returned error can't find the container with id d8fd6cb4c120f29b3f4741dc641464b90b3b0e528dcc66b6bdf2f953ac670990
Jul 08 01:53:08.447840 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:08.447813    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zqmqr"]
Jul 08 01:53:08.449724 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:53:08.449682    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a488b61_01d3_411a_9a17_a55dd52eb600.slice/crio-7c35ec0a53fb48f5aab01774ad820aff4f5a10dccc332d1c5007c9fad5e5c65d WatchSource:0}: Error finding container 7c35ec0a53fb48f5aab01774ad820aff4f5a10dccc332d1c5007c9fad5e5c65d: Status 404 returned error can't find the container with id 7c35ec0a53fb48f5aab01774ad820aff4f5a10dccc332d1c5007c9fad5e5c65d
Jul 08 01:53:09.308566 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:09.308486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zqmqr" event={"ID":"2a488b61-01d3-411a-9a17-a55dd52eb600","Type":"ContainerStarted","Data":"7c35ec0a53fb48f5aab01774ad820aff4f5a10dccc332d1c5007c9fad5e5c65d"}
Jul 08 01:53:09.310365 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:09.310333    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2" event={"ID":"943cf9b3-dd7b-411c-bbcb-d41a13093709","Type":"ContainerStarted","Data":"d8fd6cb4c120f29b3f4741dc641464b90b3b0e528dcc66b6bdf2f953ac670990"}
Jul 08 01:53:11.322323 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.322286    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zqmqr" event={"ID":"2a488b61-01d3-411a-9a17-a55dd52eb600","Type":"ContainerStarted","Data":"382a885a38e6dafd4145d0637f2f49aff33e6d14bf894432ab6acacd54d3ab7f"}
Jul 08 01:53:11.322800 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.322782    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:11.324470 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.324445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2" event={"ID":"943cf9b3-dd7b-411c-bbcb-d41a13093709","Type":"ContainerStarted","Data":"2b0c83cddcd54194f9356fa026378a6d2e9ddbef38e8c8f713be09ba0fea2ee0"}
Jul 08 01:53:11.324597 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.324519    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:11.326472 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.326415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m" event={"ID":"fb2d6066-b7a2-4f26-b323-9d9cdf6ba409","Type":"ContainerStarted","Data":"1b4de13395d2e5ace28dd3be65ae8b9a3f49e54dc9f58499dc45ceea0fb065b0"}
Jul 08 01:53:11.326570 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.326472    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:11.339266 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.339225    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zqmqr" podStartSLOduration=2.356561551 podStartE2EDuration="4.339212442s" totalImagesPullingTime="1.982650891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:53:11.336916699 +0000 UTC m=+653.702750421" watchObservedRunningTime="2026-07-08 01:53:11.339212442 +0000 UTC m=+653.705046165"
Jul 08 01:53:11.352811 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.352767    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2" podStartSLOduration=2.351930207 podStartE2EDuration="4.352751754s" totalImagesPullingTime="2.000821547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:53:11.351487882 +0000 UTC m=+653.717321607" watchObservedRunningTime="2026-07-08 01:53:11.352751754 +0000 UTC m=+653.718585476"
Jul 08 01:53:11.368892 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:11.368850    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m" podStartSLOduration=1.866971497 podStartE2EDuration="4.368834173s" totalImagesPullingTime="2.501862676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:53:11.367621573 +0000 UTC m=+653.733455296" watchObservedRunningTime="2026-07-08 01:53:11.368834173 +0000 UTC m=+653.734667896"
Jul 08 01:53:16.353210 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:16.353175    2582 generic.go:356] "Generic (PLEG): container finished" podID="9f14c1af-ba7b-488f-b32f-7569d3ab8268" containerID="e09754ab096b05fc20f74898d175be0934776f3bbe17a2f7620d810e31a73a21" exitCode=0
Jul 08 01:53:16.353631 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:16.353247    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" event={"ID":"9f14c1af-ba7b-488f-b32f-7569d3ab8268","Type":"ContainerDied","Data":"e09754ab096b05fc20f74898d175be0934776f3bbe17a2f7620d810e31a73a21"}
Jul 08 01:53:16.353631 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:16.353623    2582 scope.go:117] "RemoveContainer" containerID="e09754ab096b05fc20f74898d175be0934776f3bbe17a2f7620d810e31a73a21"
Jul 08 01:53:16.354695 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:16.354669    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 01:53:16.354790 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:16.354761    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 01:53:16.354829 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:16.354799    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 01:53:16.534790 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:16.534755    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:17.337749 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:17.337698    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6f969cb5c6-jmd9m"
Jul 08 01:53:17.360962 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:17.360930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" event={"ID":"9f14c1af-ba7b-488f-b32f-7569d3ab8268","Type":"ContainerStarted","Data":"82909646a463b4721a2285bf16a51e17422ff65981411472c8c1ff0b32544590"}
Jul 08 01:53:17.841417 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:17.841378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:18.135886 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:18.135801    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:53:18.136858 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:18.136831    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cjq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 08 01:53:18.136972 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:18.136881    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" podUID="9f14c1af-ba7b-488f-b32f-7569d3ab8268" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 08 01:53:18.362465 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:18.362422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:18.472270 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:18.472233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:19.135841 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:19.135804    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cjq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 08 01:53:19.136028 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:19.135867    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" podUID="9f14c1af-ba7b-488f-b32f-7569d3ab8268" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 08 01:53:20.135947 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:20.135909    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cjq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 08 01:53:20.136354 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:20.135966    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" podUID="9f14c1af-ba7b-488f-b32f-7569d3ab8268" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 08 01:53:20.878143 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:20.878106    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:53:21.135897 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:21.135802    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-cjq7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 08 01:53:21.135897 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:21.135868    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c" podUID="9f14c1af-ba7b-488f-b32f-7569d3ab8268" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 08 01:53:22.139427 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:22.139390    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:53:22.140567 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:22.140544    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-cjq7c"
Jul 08 01:53:22.333969 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:22.333923    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2" podUID="943cf9b3-dd7b-411c-bbcb-d41a13093709" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.46:9004: connect: connection refused"
Jul 08 01:53:23.340608 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:23.340581    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zqmqr"
Jul 08 01:53:26.747430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.747397    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"]
Jul 08 01:53:26.750938 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.750915    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.754012 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.753989    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 01:53:26.761214 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.755634    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hz9bp\""
Jul 08 01:53:26.761214 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.755748    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 01:53:26.761214 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.755644    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 01:53:26.763373 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.762577    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"]
Jul 08 01:53:26.773163 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.773129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:26.807219 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.807174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7767164-f509-4e0d-ac48-7df79a5284ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.807219 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.807219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.807499 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.807274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.807499 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.807313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.807499 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.807397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtwhz\" (UniqueName: \"kubernetes.io/projected/d7767164-f509-4e0d-ac48-7df79a5284ec-kube-api-access-qtwhz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.807499 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.807483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908158 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908382 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7767164-f509-4e0d-ac48-7df79a5284ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908382 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908382 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908382 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908604 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtwhz\" (UniqueName: \"kubernetes.io/projected/d7767164-f509-4e0d-ac48-7df79a5284ec-kube-api-access-qtwhz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908749 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908698    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908814 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908698    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.908814 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.908780    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.910569 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.910540    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7767164-f509-4e0d-ac48-7df79a5284ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.910768 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.910749    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7767164-f509-4e0d-ac48-7df79a5284ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:26.917043 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:26.917019    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtwhz\" (UniqueName: \"kubernetes.io/projected/d7767164-f509-4e0d-ac48-7df79a5284ec-kube-api-access-qtwhz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88\" (UID: \"d7767164-f509-4e0d-ac48-7df79a5284ec\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:27.072110 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:27.072020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:27.209148 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:27.209122    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"]
Jul 08 01:53:27.211089 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:53:27.211055    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7767164_f509_4e0d_ac48_7df79a5284ec.slice/crio-dd9fa890c9352623797b1baaf00497cd01ec8d1d435c83b898351cd0e4b9706b WatchSource:0}: Error finding container dd9fa890c9352623797b1baaf00497cd01ec8d1d435c83b898351cd0e4b9706b: Status 404 returned error can't find the container with id dd9fa890c9352623797b1baaf00497cd01ec8d1d435c83b898351cd0e4b9706b
Jul 08 01:53:27.418034 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:27.417935    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88" event={"ID":"d7767164-f509-4e0d-ac48-7df79a5284ec","Type":"ContainerStarted","Data":"dd9fa890c9352623797b1baaf00497cd01ec8d1d435c83b898351cd0e4b9706b"}
Jul 08 01:53:28.424275 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:28.424231    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88" event={"ID":"d7767164-f509-4e0d-ac48-7df79a5284ec","Type":"ContainerStarted","Data":"3eaa6024e1987fb403930c6880f41f0463921ef9dccd0928d1b8b306cff0e202"}
Jul 08 01:53:28.442353 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:28.442305    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88" podStartSLOduration=1.460621005 podStartE2EDuration="2.442286085s" totalImagesPullingTime="981.66508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:53:28.441988525 +0000 UTC m=+670.807822496" watchObservedRunningTime="2026-07-08 01:53:28.442286085 +0000 UTC m=+670.808119811"
Jul 08 01:53:32.333239 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:32.333207    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-g7kb2"
Jul 08 01:53:36.661700 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:36.661655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:37.072361 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:37.072321    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:37.072575 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:37.072413    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:37.087066 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:37.087041    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:37.480920 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:37.480891    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88"
Jul 08 01:53:38.088947 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:38.088899    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:42.362343 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:42.362304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:49.443075 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.443044    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"]
Jul 08 01:53:49.446380 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.446362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.450127 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.450107    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 08 01:53:49.462602 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.462571    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"]
Jul 08 01:53:49.475276 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.475235    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:49.620021 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.619975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgwkt\" (UniqueName: \"kubernetes.io/projected/be0669c8-9268-4feb-adda-d462653347be-kube-api-access-cgwkt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.620021 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.620021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be0669c8-9268-4feb-adda-d462653347be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.620277 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.620219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.620277 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.620260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.620365 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.620287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.620365 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.620334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721440 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721440 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721440 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721748 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721748 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgwkt\" (UniqueName: \"kubernetes.io/projected/be0669c8-9268-4feb-adda-d462653347be-kube-api-access-cgwkt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721748 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be0669c8-9268-4feb-adda-d462653347be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721898 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721799    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721898 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.721969 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.721905    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.723753 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.723732    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be0669c8-9268-4feb-adda-d462653347be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.724051 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.724031    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be0669c8-9268-4feb-adda-d462653347be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.730174 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.730149    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgwkt\" (UniqueName: \"kubernetes.io/projected/be0669c8-9268-4feb-adda-d462653347be-kube-api-access-cgwkt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn\" (UID: \"be0669c8-9268-4feb-adda-d462653347be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.764484 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.764448    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:49.911463 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:49.911433    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"]
Jul 08 01:53:49.915015 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:53:49.914989    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe0669c8_9268_4feb_adda_d462653347be.slice/crio-21e2864b77d0804c882c43aa35e0224bf3636444cca57cc0ef705cf564c69854 WatchSource:0}: Error finding container 21e2864b77d0804c882c43aa35e0224bf3636444cca57cc0ef705cf564c69854: Status 404 returned error can't find the container with id 21e2864b77d0804c882c43aa35e0224bf3636444cca57cc0ef705cf564c69854
Jul 08 01:53:50.534071 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:50.534034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn" event={"ID":"be0669c8-9268-4feb-adda-d462653347be","Type":"ContainerStarted","Data":"7b53cfb230e260861a61f943ce558aeef082de03425c4c52375a569c9dc1abbd"}
Jul 08 01:53:50.534487 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:50.534091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn" event={"ID":"be0669c8-9268-4feb-adda-d462653347be","Type":"ContainerStarted","Data":"21e2864b77d0804c882c43aa35e0224bf3636444cca57cc0ef705cf564c69854"}
Jul 08 01:53:50.555992 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:50.555930    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn" podStartSLOduration=1.377549723 podStartE2EDuration="1.555907781s" totalImagesPullingTime="178.358058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:53:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:53:50.553127616 +0000 UTC m=+692.918961340" watchObservedRunningTime="2026-07-08 01:53:50.555907781 +0000 UTC m=+692.921741506"
Jul 08 01:53:53.618592 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:53.618557    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:56.433676 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.433633    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"]
Jul 08 01:53:56.437512 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.437493    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.440468 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.440437    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 08 01:53:56.446543 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.446516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"]
Jul 08 01:53:56.480353 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.480315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f418f1a0-e270-491a-a750-677d98f59898-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.480526 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.480373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.480526 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.480456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqqn\" (UniqueName: \"kubernetes.io/projected/f418f1a0-e270-491a-a750-677d98f59898-kube-api-access-trqqn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.480526 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.480500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.480636 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.480541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.480636 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.480579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.545019 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.544977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:53:56.580984 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.580949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.580984 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.580987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.581240 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.581013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.581240 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.581038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f418f1a0-e270-491a-a750-677d98f59898-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.581240 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.581150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.581380 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.581256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqqn\" (UniqueName: \"kubernetes.io/projected/f418f1a0-e270-491a-a750-677d98f59898-kube-api-access-trqqn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.581414 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.581397    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.581475 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.581455    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.581553 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.581534    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.583417 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.583393    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f418f1a0-e270-491a-a750-677d98f59898-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.583564 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.583547    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f418f1a0-e270-491a-a750-677d98f59898-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.590037 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.590015    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqqn\" (UniqueName: \"kubernetes.io/projected/f418f1a0-e270-491a-a750-677d98f59898-kube-api-access-trqqn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wldm7\" (UID: \"f418f1a0-e270-491a-a750-677d98f59898\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.749987 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.749936    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:53:56.913247 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.913221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"]
Jul 08 01:53:56.915162 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:53:56.915135    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf418f1a0_e270_491a_a750_677d98f59898.slice/crio-7c13516b59b671c16f250b031c560802ad3de111ad2d5d4caf86251037b036f6 WatchSource:0}: Error finding container 7c13516b59b671c16f250b031c560802ad3de111ad2d5d4caf86251037b036f6: Status 404 returned error can't find the container with id 7c13516b59b671c16f250b031c560802ad3de111ad2d5d4caf86251037b036f6
Jul 08 01:53:56.916345 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:56.916330    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 01:53:57.573563 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:57.573520    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7" event={"ID":"f418f1a0-e270-491a-a750-677d98f59898","Type":"ContainerStarted","Data":"f0f0a6e5707c3fe2c7cd5b7b838afe9cc5a18b77599e290c538444681984f6e7"}
Jul 08 01:53:57.574038 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:57.573581    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7" event={"ID":"f418f1a0-e270-491a-a750-677d98f59898","Type":"ContainerStarted","Data":"7c13516b59b671c16f250b031c560802ad3de111ad2d5d4caf86251037b036f6"}
Jul 08 01:53:57.593498 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:57.593441    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7" podStartSLOduration=1.4176873890000001 podStartE2EDuration="1.593424147s" totalImagesPullingTime="175.736758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:53:57.592183226 +0000 UTC m=+699.958016947" watchObservedRunningTime="2026-07-08 01:53:57.593424147 +0000 UTC m=+699.959257881"
Jul 08 01:53:59.765150 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:59.765108    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:59.765640 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:59.765192    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:53:59.778218 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:53:59.778180    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:54:00.605290 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:00.605254    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn"
Jul 08 01:54:02.565375 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:02.565328    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:54:06.750623 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:06.750585    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:54:06.751069 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:06.750681    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:54:06.763209 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:06.763178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:54:07.640196 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:07.640157    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wldm7"
Jul 08 01:54:16.123769 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:16.123683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:54:16.223153 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:16.223099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:54:18.451514 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:18.451475    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:54:33.547129 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:33.547097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:54:44.138561 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:44.138523    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:54:44.236514 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:44.236442    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:54:45.299336 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:45.299306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:54:45.401126 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:54:45.401095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:55:01.492349 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:01.492303    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:55:12.857370 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:12.857335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:55:34.354082 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:34.354052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:55:58.207835 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.207752    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:55:58.305300 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.305220    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-764c6698d4-b9gpg"]
Jul 08 01:55:58.305507 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.305481    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-764c6698d4-b9gpg" podUID="06201c7d-170f-4af2-9475-1d99a5fbb59e" containerName="manager" containerID="cri-o://93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919" gracePeriod=30
Jul 08 01:55:58.560341 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.560310    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:55:58.711480 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.711441    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz94w\" (UniqueName: \"kubernetes.io/projected/06201c7d-170f-4af2-9475-1d99a5fbb59e-kube-api-access-zz94w\") pod \"06201c7d-170f-4af2-9475-1d99a5fbb59e\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") "
Jul 08 01:55:58.711669 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.711504    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06201c7d-170f-4af2-9475-1d99a5fbb59e-service-ca\") pod \"06201c7d-170f-4af2-9475-1d99a5fbb59e\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") "
Jul 08 01:55:58.711669 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.711537    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06201c7d-170f-4af2-9475-1d99a5fbb59e-webhook-cert\") pod \"06201c7d-170f-4af2-9475-1d99a5fbb59e\" (UID: \"06201c7d-170f-4af2-9475-1d99a5fbb59e\") "
Jul 08 01:55:58.711930 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.711907    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06201c7d-170f-4af2-9475-1d99a5fbb59e-service-ca" (OuterVolumeSpecName: "service-ca") pod "06201c7d-170f-4af2-9475-1d99a5fbb59e" (UID: "06201c7d-170f-4af2-9475-1d99a5fbb59e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 01:55:58.713689 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.713655    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06201c7d-170f-4af2-9475-1d99a5fbb59e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "06201c7d-170f-4af2-9475-1d99a5fbb59e" (UID: "06201c7d-170f-4af2-9475-1d99a5fbb59e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 01:55:58.713818 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.713731    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06201c7d-170f-4af2-9475-1d99a5fbb59e-kube-api-access-zz94w" (OuterVolumeSpecName: "kube-api-access-zz94w") pod "06201c7d-170f-4af2-9475-1d99a5fbb59e" (UID: "06201c7d-170f-4af2-9475-1d99a5fbb59e"). InnerVolumeSpecName "kube-api-access-zz94w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 01:55:58.813316 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.813218    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz94w\" (UniqueName: \"kubernetes.io/projected/06201c7d-170f-4af2-9475-1d99a5fbb59e-kube-api-access-zz94w\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:55:58.813316 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.813251    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06201c7d-170f-4af2-9475-1d99a5fbb59e-service-ca\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:55:58.813316 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:58.813260    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06201c7d-170f-4af2-9475-1d99a5fbb59e-webhook-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 01:55:59.190688 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.190656    2582 generic.go:356] "Generic (PLEG): container finished" podID="06201c7d-170f-4af2-9475-1d99a5fbb59e" containerID="93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919" exitCode=0
Jul 08 01:55:59.190881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.190722    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-764c6698d4-b9gpg"
Jul 08 01:55:59.190881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.190746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-764c6698d4-b9gpg" event={"ID":"06201c7d-170f-4af2-9475-1d99a5fbb59e","Type":"ContainerDied","Data":"93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919"}
Jul 08 01:55:59.190881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.190796    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-764c6698d4-b9gpg" event={"ID":"06201c7d-170f-4af2-9475-1d99a5fbb59e","Type":"ContainerDied","Data":"db9432f74733a0ba92b1b657ec8b75e3b50731bab1beae262e30e0a05a01c931"}
Jul 08 01:55:59.190881 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.190818    2582 scope.go:117] "RemoveContainer" containerID="93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919"
Jul 08 01:55:59.200591 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.200572    2582 scope.go:117] "RemoveContainer" containerID="93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919"
Jul 08 01:55:59.200901 ip-10-0-138-104 kubenswrapper[2582]: E0708 01:55:59.200881    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919\": container with ID starting with 93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919 not found: ID does not exist" containerID="93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919"
Jul 08 01:55:59.200951 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.200912    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919"} err="failed to get container status \"93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919\": rpc error: code = NotFound desc = could not find container \"93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919\": container with ID starting with 93d7196274e6d1c9f63ab0d837de76c5337b6027fff67a2c2c0e2c380e914919 not found: ID does not exist"
Jul 08 01:55:59.214403 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.214371    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-764c6698d4-b9gpg"]
Jul 08 01:55:59.216253 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.216231    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-764c6698d4-b9gpg"]
Jul 08 01:55:59.872430 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.872396    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:55:59.987802 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.984624    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-764c6698d4-z2sld"]
Jul 08 01:55:59.987802 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.985683    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06201c7d-170f-4af2-9475-1d99a5fbb59e" containerName="manager"
Jul 08 01:55:59.987802 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.985719    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="06201c7d-170f-4af2-9475-1d99a5fbb59e" containerName="manager"
Jul 08 01:55:59.987802 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.985938    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="06201c7d-170f-4af2-9475-1d99a5fbb59e" containerName="manager"
Jul 08 01:55:59.993719 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.993676    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:55:59.996628 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.996599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-764c6698d4-z2sld"]
Jul 08 01:55:59.997769 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.997742    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 01:55:59.997769 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.997762    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 01:55:59.997959 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:55:59.997742    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r46wg\""
Jul 08 01:56:00.125582 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.125466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/204ae3bc-4129-479c-8ed1-6a63b3941b6b-service-ca\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.125582 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.125519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp2dg\" (UniqueName: \"kubernetes.io/projected/204ae3bc-4129-479c-8ed1-6a63b3941b6b-kube-api-access-dp2dg\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.125819 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.125597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/204ae3bc-4129-479c-8ed1-6a63b3941b6b-webhook-cert\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.165694 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.165654    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06201c7d-170f-4af2-9475-1d99a5fbb59e" path="/var/lib/kubelet/pods/06201c7d-170f-4af2-9475-1d99a5fbb59e/volumes"
Jul 08 01:56:00.226849 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.226804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/204ae3bc-4129-479c-8ed1-6a63b3941b6b-service-ca\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.226849 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.226855    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp2dg\" (UniqueName: \"kubernetes.io/projected/204ae3bc-4129-479c-8ed1-6a63b3941b6b-kube-api-access-dp2dg\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.227289 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.226986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/204ae3bc-4129-479c-8ed1-6a63b3941b6b-webhook-cert\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.227542 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.227517    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/204ae3bc-4129-479c-8ed1-6a63b3941b6b-service-ca\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.229389 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.229358    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/204ae3bc-4129-479c-8ed1-6a63b3941b6b-webhook-cert\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.235593 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.235565    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp2dg\" (UniqueName: \"kubernetes.io/projected/204ae3bc-4129-479c-8ed1-6a63b3941b6b-kube-api-access-dp2dg\") pod \"maas-controller-764c6698d4-z2sld\" (UID: \"204ae3bc-4129-479c-8ed1-6a63b3941b6b\") " pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.306604 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.306556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:00.452753 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:00.452722    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-764c6698d4-z2sld"]
Jul 08 01:56:00.454813 ip-10-0-138-104 kubenswrapper[2582]: W0708 01:56:00.454778    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204ae3bc_4129_479c_8ed1_6a63b3941b6b.slice/crio-1e3a5ace4c0f5664711cd4fee20d236bee389f0a297d392d674978f19464bb47 WatchSource:0}: Error finding container 1e3a5ace4c0f5664711cd4fee20d236bee389f0a297d392d674978f19464bb47: Status 404 returned error can't find the container with id 1e3a5ace4c0f5664711cd4fee20d236bee389f0a297d392d674978f19464bb47
Jul 08 01:56:01.203157 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:01.203127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-764c6698d4-z2sld" event={"ID":"204ae3bc-4129-479c-8ed1-6a63b3941b6b","Type":"ContainerStarted","Data":"f3b0a5da6d8562b29f3406ec92c7b614d4cab0c5a668d4e8ea8d15a1bc37b3f4"}
Jul 08 01:56:01.203372 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:01.203182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-764c6698d4-z2sld" event={"ID":"204ae3bc-4129-479c-8ed1-6a63b3941b6b","Type":"ContainerStarted","Data":"1e3a5ace4c0f5664711cd4fee20d236bee389f0a297d392d674978f19464bb47"}
Jul 08 01:56:01.203372 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:01.203219    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:01.222254 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:01.222198    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-764c6698d4-z2sld" podStartSLOduration=1.802179033 podStartE2EDuration="2.222182946s" totalImagesPullingTime="420.003913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:56:01.221670251 +0000 UTC m=+823.587503973" watchObservedRunningTime="2026-07-08 01:56:01.222182946 +0000 UTC m=+823.588016681"
Jul 08 01:56:12.214026 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:12.213996    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-764c6698d4-z2sld"
Jul 08 01:56:42.675099 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:42.675054    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:42.766331 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:42.766280    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:42.899060 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:42.899031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:48.605538 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:48.605502    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:48.677190 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:48.677153    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:48.777822 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:48.777793    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:48.878148 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:48.878060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:48.978300 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:48.978265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:54.753256 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:54.753222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:56:54.861493 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:56:54.861460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 01:57:18.137007 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:57:18.136913    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 01:57:18.139033 ip-10-0-138-104 kubenswrapper[2582]: I0708 01:57:18.139007    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:00:00.152536 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.152498    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"]
Jul 08 02:00:00.156004 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.155985    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"
Jul 08 02:00:00.170276 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.170250    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"]
Jul 08 02:00:00.310128 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.310086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq887\" (UniqueName: \"kubernetes.io/projected/8550dc89-e2aa-41d1-9929-7defd12a6364-kube-api-access-pq887\") pod \"maas-api-key-cleanup-29724600-k92l2\" (UID: \"8550dc89-e2aa-41d1-9929-7defd12a6364\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"
Jul 08 02:00:00.410964 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.410865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq887\" (UniqueName: \"kubernetes.io/projected/8550dc89-e2aa-41d1-9929-7defd12a6364-kube-api-access-pq887\") pod \"maas-api-key-cleanup-29724600-k92l2\" (UID: \"8550dc89-e2aa-41d1-9929-7defd12a6364\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"
Jul 08 02:00:00.419715 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.419667    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq887\" (UniqueName: \"kubernetes.io/projected/8550dc89-e2aa-41d1-9929-7defd12a6364-kube-api-access-pq887\") pod \"maas-api-key-cleanup-29724600-k92l2\" (UID: \"8550dc89-e2aa-41d1-9929-7defd12a6364\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"
Jul 08 02:00:00.468275 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.468237    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"
Jul 08 02:00:00.609338 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.609314    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"]
Jul 08 02:00:00.611607 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:00:00.611578    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8550dc89_e2aa_41d1_9929_7defd12a6364.slice/crio-abafa1c8b8665d461f0c1aa787710cf6aad82ee7292e25343ec798e097f89a62 WatchSource:0}: Error finding container abafa1c8b8665d461f0c1aa787710cf6aad82ee7292e25343ec798e097f89a62: Status 404 returned error can't find the container with id abafa1c8b8665d461f0c1aa787710cf6aad82ee7292e25343ec798e097f89a62
Jul 08 02:00:00.613449 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:00.613430    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 02:00:01.408786 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:01.408748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2" event={"ID":"8550dc89-e2aa-41d1-9929-7defd12a6364","Type":"ContainerStarted","Data":"abafa1c8b8665d461f0c1aa787710cf6aad82ee7292e25343ec798e097f89a62"}
Jul 08 02:00:05.430442 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:05.430404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2" event={"ID":"8550dc89-e2aa-41d1-9929-7defd12a6364","Type":"ContainerStarted","Data":"b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329"}
Jul 08 02:00:05.450067 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:00:05.449961    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2" podStartSLOduration=1.120671599 podStartE2EDuration="5.449944271s" totalImagesPullingTime="4.329272672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:00:05.446599389 +0000 UTC m=+1067.812433112" watchObservedRunningTime="2026-07-08 02:00:05.449944271 +0000 UTC m=+1067.815777994"
Jul 08 02:01:00.011061 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:00.011020    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"]
Jul 08 02:01:00.011624 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:00.011226    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2" podUID="8550dc89-e2aa-41d1-9929-7defd12a6364" containerName="cleanup" containerID="cri-o://b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329" gracePeriod=30
Jul 08 02:01:30.211019 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.210990    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"
Jul 08 02:01:30.346104 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.346001    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq887\" (UniqueName: \"kubernetes.io/projected/8550dc89-e2aa-41d1-9929-7defd12a6364-kube-api-access-pq887\") pod \"8550dc89-e2aa-41d1-9929-7defd12a6364\" (UID: \"8550dc89-e2aa-41d1-9929-7defd12a6364\") "
Jul 08 02:01:30.348227 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.348199    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8550dc89-e2aa-41d1-9929-7defd12a6364-kube-api-access-pq887" (OuterVolumeSpecName: "kube-api-access-pq887") pod "8550dc89-e2aa-41d1-9929-7defd12a6364" (UID: "8550dc89-e2aa-41d1-9929-7defd12a6364"). InnerVolumeSpecName "kube-api-access-pq887". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:01:30.447233 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.447193    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq887\" (UniqueName: \"kubernetes.io/projected/8550dc89-e2aa-41d1-9929-7defd12a6364-kube-api-access-pq887\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:01:30.860584 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.860549    2582 generic.go:356] "Generic (PLEG): container finished" podID="8550dc89-e2aa-41d1-9929-7defd12a6364" containerID="b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329" exitCode=137
Jul 08 02:01:30.860803 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.860596    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"
Jul 08 02:01:30.860803 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.860641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2" event={"ID":"8550dc89-e2aa-41d1-9929-7defd12a6364","Type":"ContainerDied","Data":"b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329"}
Jul 08 02:01:30.860803 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.860701    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2" event={"ID":"8550dc89-e2aa-41d1-9929-7defd12a6364","Type":"ContainerDied","Data":"abafa1c8b8665d461f0c1aa787710cf6aad82ee7292e25343ec798e097f89a62"}
Jul 08 02:01:30.860803 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.860757    2582 scope.go:117] "RemoveContainer" containerID="b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329"
Jul 08 02:01:30.869785 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.869769    2582 scope.go:117] "RemoveContainer" containerID="b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329"
Jul 08 02:01:30.870039 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:01:30.870023    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329\": container with ID starting with b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329 not found: ID does not exist" containerID="b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329"
Jul 08 02:01:30.870121 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.870045    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329"} err="failed to get container status \"b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329\": rpc error: code = NotFound desc = could not find container \"b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329\": container with ID starting with b27ca9bbe141516d953fc62da7465b0d199c5ed69ad0974bd64e1bb22e688329 not found: ID does not exist"
Jul 08 02:01:30.882541 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.882516    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"]
Jul 08 02:01:30.886058 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:30.886040    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724600-k92l2"]
Jul 08 02:01:32.166078 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:32.166048    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8550dc89-e2aa-41d1-9929-7defd12a6364" path="/var/lib/kubelet/pods/8550dc89-e2aa-41d1-9929-7defd12a6364/volumes"
Jul 08 02:01:37.964838 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:01:37.964799    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:02:18.171433 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:02:18.171407    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:02:18.174483 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:02:18.174460    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:02:56.580112 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:02:56.580050    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:03:07.560580 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:03:07.560541    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:03:16.230541 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:03:16.230509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:04:14.310880 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:04:14.310841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:04:14.365178 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:04:14.365142    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:07:18.203584 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:07:18.203551    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:07:18.207221 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:07:18.207194    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:08:02.364127 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:02.364091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:08.906404 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:08.906369    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:17.173667 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:17.173624    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:22.277798 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:22.277760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:25.121880 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:25.121847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:25.220648 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:25.220608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:25.583634 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:25.583598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:31.264175 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.264140    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:31.364870 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.364834    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:31.442749 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.442687    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"]
Jul 08 02:08:31.443432 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.443405    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8550dc89-e2aa-41d1-9929-7defd12a6364" containerName="cleanup"
Jul 08 02:08:31.443432 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.443434    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8550dc89-e2aa-41d1-9929-7defd12a6364" containerName="cleanup"
Jul 08 02:08:31.443599 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.443538    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8550dc89-e2aa-41d1-9929-7defd12a6364" containerName="cleanup"
Jul 08 02:08:31.446915 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.446893    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.449797 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.449773    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-632ff5cb-openshift-default-dockercfg-5hnbj\""
Jul 08 02:08:31.464133 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.464099    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"]
Jul 08 02:08:31.471223 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.471186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:31.508006 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.507970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4k8s\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-kube-api-access-x4k8s\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.508201 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.508033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-podinfo\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.508201 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.508107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-token\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.508201 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.508141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-data\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.508201 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.508171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-socket\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.508345 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.508203    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-certs\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.508345 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.508230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-envoy\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.508345 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.508272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69666842-a855-4ce4-81b9-8c84b2e44a15-istiod-ca-cert\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.508345 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.508312    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-credential-socket\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.529137 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.529048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:31.609364 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-credential-socket\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.609565 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4k8s\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-kube-api-access-x4k8s\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.609565 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-podinfo\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.609565 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-token\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.609565 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-data\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.609832 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-socket\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.609832 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-certs\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.609832 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-envoy\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.609832 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69666842-a855-4ce4-81b9-8c84b2e44a15-istiod-ca-cert\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.610027 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609894    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-credential-socket\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.610027 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.609960    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-data\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.610124 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.610101    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-socket\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.610218 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.610195    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-certs\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.610444 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.610423    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69666842-a855-4ce4-81b9-8c84b2e44a15-istiod-ca-cert\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.612005 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.611979    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-podinfo\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.612126 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.612084    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-envoy\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.617893 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.617863    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-token\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.618022 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.617969    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4k8s\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-kube-api-access-x4k8s\") pod \"e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") " pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.758166 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.758126    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:31.906085 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.906058    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"]
Jul 08 02:08:31.907809 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:08:31.907778    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69666842_a855_4ce4_81b9_8c84b2e44a15.slice/crio-4d1f99fec261bfc07e4bd9b99cc678bfb22567baeb50a63ff38d8ea3779bc300 WatchSource:0}: Error finding container 4d1f99fec261bfc07e4bd9b99cc678bfb22567baeb50a63ff38d8ea3779bc300: Status 404 returned error can't find the container with id 4d1f99fec261bfc07e4bd9b99cc678bfb22567baeb50a63ff38d8ea3779bc300
Jul 08 02:08:31.910071 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.910037    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:08:31.910166 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.910112    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:08:31.910166 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:31.910145    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:08:32.035764 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:32.035693    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh" event={"ID":"69666842-a855-4ce4-81b9-8c84b2e44a15","Type":"ContainerStarted","Data":"f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad"}
Jul 08 02:08:32.035949 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:32.035789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh" event={"ID":"69666842-a855-4ce4-81b9-8c84b2e44a15","Type":"ContainerStarted","Data":"4d1f99fec261bfc07e4bd9b99cc678bfb22567baeb50a63ff38d8ea3779bc300"}
Jul 08 02:08:32.056139 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:32.056071    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh" podStartSLOduration=1.056046247 podStartE2EDuration="1.056046247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:08:32.053559563 +0000 UTC m=+1574.419393327" watchObservedRunningTime="2026-07-08 02:08:32.056046247 +0000 UTC m=+1574.421879970"
Jul 08 02:08:32.568145 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:32.568097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:32.667177 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:32.667139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:32.758794 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:32.758758    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:32.764423 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:32.764390    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:32.812883 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:32.812833    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:33.041308 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:33.041265    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:33.042298 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:33.042266    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:33.053606 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:33.053571    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:33.324790 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:33.324663    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:33.427519 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:33.427483    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:35.528209 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:35.528176    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:40.720688 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:40.720648    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:40.785649 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:40.785613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:40.881830 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:40.881781    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"]
Jul 08 02:08:40.882125 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:40.882087    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh" podUID="69666842-a855-4ce4-81b9-8c84b2e44a15" containerName="istio-proxy" containerID="cri-o://f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad" gracePeriod=30
Jul 08 02:08:40.902422 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:40.902385    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:41.013512 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:41.013417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:42.912222 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:42.912186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:44.751893 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.751865    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:44.844812 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.844690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-podinfo\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.844812 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.844778    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-data\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.844812 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.844809    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-socket\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.845108 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.844827    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-certs\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.845108 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.844877    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-token\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.845108 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.844933    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4k8s\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-kube-api-access-x4k8s\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.845108 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.844968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-envoy\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.845108 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.844998    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-credential-socket\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.845108 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.845031    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69666842-a855-4ce4-81b9-8c84b2e44a15-istiod-ca-cert\") pod \"69666842-a855-4ce4-81b9-8c84b2e44a15\" (UID: \"69666842-a855-4ce4-81b9-8c84b2e44a15\") "
Jul 08 02:08:44.845418 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.845149    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:44.845418 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.845166    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:44.845418 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.845375    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:44.845418 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.845401    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:44.845633 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.845421    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:44.845633 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.845489    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69666842-a855-4ce4-81b9-8c84b2e44a15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:08:44.845777 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.845665    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-data" (OuterVolumeSpecName: "istio-data") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:44.847114 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.847085    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:08:44.847282 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.847259    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-kube-api-access-x4k8s" (OuterVolumeSpecName: "kube-api-access-x4k8s") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "kube-api-access-x4k8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:08:44.847577 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.847548    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-token" (OuterVolumeSpecName: "istio-token") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:08:44.847577 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.847543    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "69666842-a855-4ce4-81b9-8c84b2e44a15" (UID: "69666842-a855-4ce4-81b9-8c84b2e44a15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:44.946632 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.946576    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4k8s\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-kube-api-access-x4k8s\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:44.946632 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.946625    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:44.946632 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.946634    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:44.946632 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.946643    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69666842-a855-4ce4-81b9-8c84b2e44a15-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:44.946632 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.946652    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:44.946986 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.946667    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:44.946986 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:44.946676    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69666842-a855-4ce4-81b9-8c84b2e44a15-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:45.110280 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.110179    2582 generic.go:356] "Generic (PLEG): container finished" podID="69666842-a855-4ce4-81b9-8c84b2e44a15" containerID="f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad" exitCode=0
Jul 08 02:08:45.110280 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.110232    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"
Jul 08 02:08:45.110280 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.110263    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh" event={"ID":"69666842-a855-4ce4-81b9-8c84b2e44a15","Type":"ContainerDied","Data":"f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad"}
Jul 08 02:08:45.110550 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.110318    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh" event={"ID":"69666842-a855-4ce4-81b9-8c84b2e44a15","Type":"ContainerDied","Data":"4d1f99fec261bfc07e4bd9b99cc678bfb22567baeb50a63ff38d8ea3779bc300"}
Jul 08 02:08:45.110550 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.110340    2582 scope.go:117] "RemoveContainer" containerID="f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad"
Jul 08 02:08:45.119949 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.119923    2582 scope.go:117] "RemoveContainer" containerID="f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad"
Jul 08 02:08:45.120249 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:08:45.120224    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad\": container with ID starting with f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad not found: ID does not exist" containerID="f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad"
Jul 08 02:08:45.120354 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.120255    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad"} err="failed to get container status \"f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad\": rpc error: code = NotFound desc = could not find container \"f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad\": container with ID starting with f473540af6a1ec09835f78f2ef9bb2dbfb31dc580a43ac2f47c1555a3efa50ad not found: ID does not exist"
Jul 08 02:08:45.132555 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.132524    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"]
Jul 08 02:08:45.135729 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:45.135678    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-632ff5cb-openshift-default-7f8977fbbf-qf2sh"]
Jul 08 02:08:46.173086 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.173045    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69666842-a855-4ce4-81b9-8c84b2e44a15" path="/var/lib/kubelet/pods/69666842-a855-4ce4-81b9-8c84b2e44a15/volumes"
Jul 08 02:08:46.585493 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.585460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:46.686013 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.685974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:46.741681 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.741302    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"]
Jul 08 02:08:46.741891 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.741853    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69666842-a855-4ce4-81b9-8c84b2e44a15" containerName="istio-proxy"
Jul 08 02:08:46.741891 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.741869    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69666842-a855-4ce4-81b9-8c84b2e44a15" containerName="istio-proxy"
Jul 08 02:08:46.742011 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.741949    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="69666842-a855-4ce4-81b9-8c84b2e44a15" containerName="istio-proxy"
Jul 08 02:08:46.748532 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.748502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.751497 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.751467    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f51bc25c-openshift-default-dockercfg-rbpmr\""
Jul 08 02:08:46.758249 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.758216    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"]
Jul 08 02:08:46.778590 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.778553    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:46.837914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.837825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:46.866069 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-data\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.866270 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add4008f-e296-4465-a9ba-e014c4c32082-istio-podinfo\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.866270 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-credential-socket\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.866270 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-envoy\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.866439 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add4008f-e296-4465-a9ba-e014c4c32082-istiod-ca-cert\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.866439 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-socket\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.866439 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-certs\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.866439 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-istio-token\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.866619 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.866456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfgx\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-kube-api-access-fsfgx\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.967542 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add4008f-e296-4465-a9ba-e014c4c32082-istio-podinfo\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.967542 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-credential-socket\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.967854 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-envoy\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.967854 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add4008f-e296-4465-a9ba-e014c4c32082-istiod-ca-cert\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.967854 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-socket\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.967854 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-certs\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.967854 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-istio-token\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.967854 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfgx\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-kube-api-access-fsfgx\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.968144 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.967899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-data\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.968144 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.968021    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-credential-socket\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.968301 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.968209    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-certs\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.968301 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.968220    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-data\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.968491 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.968439    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add4008f-e296-4465-a9ba-e014c4c32082-istiod-ca-cert\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.968606 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.968586    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-socket\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.970080 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.970059    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-envoy\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.970197 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.970178    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add4008f-e296-4465-a9ba-e014c4c32082-istio-podinfo\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.977038 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.977009    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-istio-token\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:46.977230 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:46.977211    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfgx\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-kube-api-access-fsfgx\") pod \"e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") " pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:47.062772 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:47.062693    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:47.215062 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:47.215029    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"]
Jul 08 02:08:47.217183 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:08:47.217150    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd4008f_e296_4465_a9ba_e014c4c32082.slice/crio-4e6641762ff30c2f2b261fe48c30bf256b16e0f815d3a8654a52eeabb78eabcc WatchSource:0}: Error finding container 4e6641762ff30c2f2b261fe48c30bf256b16e0f815d3a8654a52eeabb78eabcc: Status 404 returned error can't find the container with id 4e6641762ff30c2f2b261fe48c30bf256b16e0f815d3a8654a52eeabb78eabcc
Jul 08 02:08:47.219425 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:47.219389    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:08:47.219503 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:47.219460    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:08:47.219503 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:47.219487    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:08:47.967479 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:47.967444    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:48.046543 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:48.046509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:48.115634 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:48.115600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:48.131430 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:48.131393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l" event={"ID":"add4008f-e296-4465-a9ba-e014c4c32082","Type":"ContainerStarted","Data":"509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54"}
Jul 08 02:08:48.131590 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:48.131452    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l" event={"ID":"add4008f-e296-4465-a9ba-e014c4c32082","Type":"ContainerStarted","Data":"4e6641762ff30c2f2b261fe48c30bf256b16e0f815d3a8654a52eeabb78eabcc"}
Jul 08 02:08:48.421899 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:48.421807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:48.531217 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:48.531182    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:48.636974 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:48.636937    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:49.063017 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:49.062988    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:49.067965 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:49.067933    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:49.091589 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:49.091535    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l" podStartSLOduration=3.09151891 podStartE2EDuration="3.09151891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:08:48.156462377 +0000 UTC m=+1590.522296101" watchObservedRunningTime="2026-07-08 02:08:49.09151891 +0000 UTC m=+1591.457352632"
Jul 08 02:08:49.136994 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:49.136964    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:49.138113 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:49.138092    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:49.815932 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:49.815891    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:56.001286 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:56.001241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:56.101209 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:56.101131    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:56.960122 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:56.960081    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"]
Jul 08 02:08:56.960374 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:56.960326    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l" podUID="add4008f-e296-4465-a9ba-e014c4c32082" containerName="istio-proxy" containerID="cri-o://509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54" gracePeriod=30
Jul 08 02:08:56.983457 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:56.983426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:57.085663 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:57.085633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:58.380804 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:58.380772    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:08:59.524457 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.524432    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:08:59.582925 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.582891    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-data\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.582925 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.582928    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add4008f-e296-4465-a9ba-e014c4c32082-istiod-ca-cert\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.583198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.582947    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-credential-socket\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.583198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.582968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-socket\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.583198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583010    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-envoy\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.583198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583119    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-istio-token\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.583198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583147    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsfgx\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-kube-api-access-fsfgx\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.583461 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583207    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add4008f-e296-4465-a9ba-e014c4c32082-istio-podinfo\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.583461 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583304    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:59.583461 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583371    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-certs\") pod \"add4008f-e296-4465-a9ba-e014c4c32082\" (UID: \"add4008f-e296-4465-a9ba-e014c4c32082\") "
Jul 08 02:08:59.583461 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583410    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/add4008f-e296-4465-a9ba-e014c4c32082-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:08:59.583724 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583671    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-data" (OuterVolumeSpecName: "istio-data") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:59.584002 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583915    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/add4008f-e296-4465-a9ba-e014c4c32082-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:59.584002 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583987    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:59.584002 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583684    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:59.584176 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.583905    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:59.585537 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.585511    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/add4008f-e296-4465-a9ba-e014c4c32082-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:08:59.585637 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.585527    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-istio-token" (OuterVolumeSpecName: "istio-token") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:08:59.585872 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.585851    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:08:59.585936 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.585843    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-kube-api-access-fsfgx" (OuterVolumeSpecName: "kube-api-access-fsfgx") pod "add4008f-e296-4465-a9ba-e014c4c32082" (UID: "add4008f-e296-4465-a9ba-e014c4c32082"). InnerVolumeSpecName "kube-api-access-fsfgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:08:59.685006 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.684963    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:59.685006 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.684995    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:59.685006 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.685007    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsfgx\" (UniqueName: \"kubernetes.io/projected/add4008f-e296-4465-a9ba-e014c4c32082-kube-api-access-fsfgx\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:59.685304 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.685020    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/add4008f-e296-4465-a9ba-e014c4c32082-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:59.685304 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.685029    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:59.685304 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.685037    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:08:59.685304 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:08:59.685045    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/add4008f-e296-4465-a9ba-e014c4c32082-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:00.205407 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.205363    2582 generic.go:356] "Generic (PLEG): container finished" podID="add4008f-e296-4465-a9ba-e014c4c32082" containerID="509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54" exitCode=0
Jul 08 02:09:00.205597 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.205419    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l" event={"ID":"add4008f-e296-4465-a9ba-e014c4c32082","Type":"ContainerDied","Data":"509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54"}
Jul 08 02:09:00.205597 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.205428    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"
Jul 08 02:09:00.205597 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.205467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l" event={"ID":"add4008f-e296-4465-a9ba-e014c4c32082","Type":"ContainerDied","Data":"4e6641762ff30c2f2b261fe48c30bf256b16e0f815d3a8654a52eeabb78eabcc"}
Jul 08 02:09:00.205597 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.205488    2582 scope.go:117] "RemoveContainer" containerID="509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54"
Jul 08 02:09:00.214846 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.214822    2582 scope.go:117] "RemoveContainer" containerID="509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54"
Jul 08 02:09:00.215190 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:09:00.215161    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54\": container with ID starting with 509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54 not found: ID does not exist" containerID="509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54"
Jul 08 02:09:00.215284 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.215204    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54"} err="failed to get container status \"509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54\": rpc error: code = NotFound desc = could not find container \"509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54\": container with ID starting with 509b92eb4901598b5e4d29e8450984cfb125b80acfb660b86278551ddae43d54 not found: ID does not exist"
Jul 08 02:09:00.224450 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.224414    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"]
Jul 08 02:09:00.227858 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:00.227827    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f51bc25c-openshift-default-645dc688cc-p8s6l"]
Jul 08 02:09:02.166554 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.166514    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="add4008f-e296-4465-a9ba-e014c4c32082" path="/var/lib/kubelet/pods/add4008f-e296-4465-a9ba-e014c4c32082/volumes"
Jul 08 02:09:02.737770 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.737687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:02.807231 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.807178    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:02.912361 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.912327    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"]
Jul 08 02:09:02.912868 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.912851    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="add4008f-e296-4465-a9ba-e014c4c32082" containerName="istio-proxy"
Jul 08 02:09:02.912957 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.912871    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="add4008f-e296-4465-a9ba-e014c4c32082" containerName="istio-proxy"
Jul 08 02:09:02.913023 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.912973    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="add4008f-e296-4465-a9ba-e014c4c32082" containerName="istio-proxy"
Jul 08 02:09:02.916068 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.916042    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:02.918856 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.918832    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2df057ea-openshift-default-dockercfg-b82dr\""
Jul 08 02:09:02.928844 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.928814    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"]
Jul 08 02:09:02.942236 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:02.942201    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:03.015529 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-envoy\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.015529 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015459    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4bv4\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-kube-api-access-p4bv4\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.015529 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istiod-ca-cert\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.015529 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-data\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.015961 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-podinfo\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.015961 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-certs\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.015961 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-socket\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.015961 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-token\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.015961 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.015949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-credential-socket\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.041379 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.041341    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:03.116944 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.116904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-credential-socket\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.116944 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.116945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-envoy\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117226 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.116985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4bv4\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-kube-api-access-p4bv4\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117226 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istiod-ca-cert\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117226 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-data\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117420 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-podinfo\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117420 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-certs\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117420 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-socket\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117420 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117375    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-credential-socket\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117420 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-token\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117688 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117510    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-data\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117688 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117656    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-socket\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117842 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117789    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-certs\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.117842 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.117817    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istiod-ca-cert\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.119363 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.119337    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-envoy\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.119681 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.119663    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-podinfo\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.125001 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.124977    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-token\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.125272 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.125251    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4bv4\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-kube-api-access-p4bv4\") pod \"e2e-derive-2df057ea-openshift-default-6694689467-gt8fl\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") " pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.228860 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.228821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:03.378820 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.378784    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"]
Jul 08 02:09:03.381760 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:09:03.381699    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc5b17d_3c35_4f2d_a99d_731716b4b875.slice/crio-4f8bfe42ead045aba160300036aa51e1c02d0c22dd95f34288375bc8154125ad WatchSource:0}: Error finding container 4f8bfe42ead045aba160300036aa51e1c02d0c22dd95f34288375bc8154125ad: Status 404 returned error can't find the container with id 4f8bfe42ead045aba160300036aa51e1c02d0c22dd95f34288375bc8154125ad
Jul 08 02:09:03.384529 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.384487    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:09:03.384605 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.384583    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:09:03.384647 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:03.384622    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:09:04.053791 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.053754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:04.129584 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.129545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:04.198384 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.198352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:04.233018 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.232978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl" event={"ID":"1fc5b17d-3c35-4f2d-a99d-731716b4b875","Type":"ContainerStarted","Data":"4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b"}
Jul 08 02:09:04.233515 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.233043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl" event={"ID":"1fc5b17d-3c35-4f2d-a99d-731716b4b875","Type":"ContainerStarted","Data":"4f8bfe42ead045aba160300036aa51e1c02d0c22dd95f34288375bc8154125ad"}
Jul 08 02:09:04.258365 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.258301    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl" podStartSLOduration=2.258280883 podStartE2EDuration="2.258280883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:09:04.256676078 +0000 UTC m=+1606.622509803" watchObservedRunningTime="2026-07-08 02:09:04.258280883 +0000 UTC m=+1606.624114608"
Jul 08 02:09:04.510028 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.509990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:04.612036 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.612007    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:04.711537 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:04.711502    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:05.229762 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:05.229684    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:05.234837 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:05.234811    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:05.238261 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:05.238235    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:05.239138 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:05.239116    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:06.003332 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:06.003259    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:11.521082 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:11.520985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:11.622380 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:11.622345    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:11.666191 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:11.666156    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"]
Jul 08 02:09:11.666415 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:11.666392    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl" podUID="1fc5b17d-3c35-4f2d-a99d-731716b4b875" containerName="istio-proxy" containerID="cri-o://4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b" gracePeriod=30
Jul 08 02:09:11.695357 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:11.695325    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:11.787532 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:11.787443    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:16.460381 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:16.460344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:16.936667 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:16.936640    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:17.057189 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-podinfo\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057189 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057128    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-data\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057189 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-credential-socket\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057473 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057276    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istiod-ca-cert\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057473 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057319    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-socket\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057473 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057349    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-certs\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057473 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057458    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:09:17.057670 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057473    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:09:17.057670 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057519    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-token\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057670 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057574    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-envoy\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057670 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057593    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:09:17.057670 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057603    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:09:17.057670 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057642    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4bv4\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-kube-api-access-p4bv4\") pod \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\" (UID: \"1fc5b17d-3c35-4f2d-a99d-731716b4b875\") "
Jul 08 02:09:17.057931 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.057690    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:09:17.058047 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.058028    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.058110 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.058054    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.058110 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.058070    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.058110 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.058085    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.058110 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.058098    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.059616 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.059585    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-kube-api-access-p4bv4" (OuterVolumeSpecName: "kube-api-access-p4bv4") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "kube-api-access-p4bv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:09:17.059616 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.059612    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:09:17.059785 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.059658    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:09:17.059785 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.059688    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fc5b17d-3c35-4f2d-a99d-731716b4b875" (UID: "1fc5b17d-3c35-4f2d-a99d-731716b4b875"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:09:17.159586 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.159538    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.159586 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.159574    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.159868 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.159598    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4bv4\" (UniqueName: \"kubernetes.io/projected/1fc5b17d-3c35-4f2d-a99d-731716b4b875-kube-api-access-p4bv4\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.159868 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.159633    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5b17d-3c35-4f2d-a99d-731716b4b875-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:09:17.303941 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.303902    2582 generic.go:356] "Generic (PLEG): container finished" podID="1fc5b17d-3c35-4f2d-a99d-731716b4b875" containerID="4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b" exitCode=0
Jul 08 02:09:17.304106 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.303958    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"
Jul 08 02:09:17.304106 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.303984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl" event={"ID":"1fc5b17d-3c35-4f2d-a99d-731716b4b875","Type":"ContainerDied","Data":"4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b"}
Jul 08 02:09:17.304106 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.304045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl" event={"ID":"1fc5b17d-3c35-4f2d-a99d-731716b4b875","Type":"ContainerDied","Data":"4f8bfe42ead045aba160300036aa51e1c02d0c22dd95f34288375bc8154125ad"}
Jul 08 02:09:17.304106 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.304075    2582 scope.go:117] "RemoveContainer" containerID="4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b"
Jul 08 02:09:17.314275 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.314255    2582 scope.go:117] "RemoveContainer" containerID="4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b"
Jul 08 02:09:17.314621 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:09:17.314602    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b\": container with ID starting with 4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b not found: ID does not exist" containerID="4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b"
Jul 08 02:09:17.314692 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.314630    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b"} err="failed to get container status \"4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b\": rpc error: code = NotFound desc = could not find container \"4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b\": container with ID starting with 4216c13f83b8ab2be87d04139a5f74abfb79cd0bd20f210e85897d709cd2108b not found: ID does not exist"
Jul 08 02:09:17.327122 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.327091    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"]
Jul 08 02:09:17.330547 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.330520    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2df057ea-openshift-default-6694689467-gt8fl"]
Jul 08 02:09:17.517094 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.517057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:17.587521 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:17.587419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:18.024148 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:18.024109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:18.123247 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:18.123216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:18.167038 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:18.167005    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fc5b17d-3c35-4f2d-a99d-731716b4b875" path="/var/lib/kubelet/pods/1fc5b17d-3c35-4f2d-a99d-731716b4b875/volumes"
Jul 08 02:09:18.223098 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:18.223064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:49.512626 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:49.512593    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:09:55.234378 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:09:55.234340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:00.779640 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:00.779606    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:00.836859 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:00.836823    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:00.923169 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:00.923135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:01.022457 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:01.022424    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:01.122492 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:01.122395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:01.538896 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:01.538853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:27.541718 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:27.541667    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:33.214317 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:33.214276    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:33.319096 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:33.319059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:33.417478 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:33.417441    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:39.869437 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:39.869397    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:41.341316 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:41.341239    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:49.329898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:49.329856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:55.282381 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:55.282341    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:55.413663 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:55.413626    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:10:55.548117 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:10:55.548025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:06.038084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:06.038053    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:06.885021 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:06.884980    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:12.587102 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:12.587062    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:12.652553 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:12.652519    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:12.731039 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:12.731006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:12.830950 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:12.830913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:12.931236 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:12.931145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:13.670778 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:13.670697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:13.799890 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:13.799850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:13.923366 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:13.923284    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:22.513822 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:22.513785    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:22.626637 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:22.626601    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:45.449782 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:45.449746    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:51.440429 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:51.440390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:58.629805 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:58.629769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:11:58.793065 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:11:58.793032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:18.241141 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:18.241107    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:12:18.250652 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:18.250628    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:12:29.376063 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:29.376000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:35.520505 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:35.520473    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:41.157190 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.157156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:41.223168 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.223129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:41.388231 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.388199    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:41.796855 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.796819    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"]
Jul 08 02:12:41.797507 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.797489    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc5b17d-3c35-4f2d-a99d-731716b4b875" containerName="istio-proxy"
Jul 08 02:12:41.797566 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.797510    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc5b17d-3c35-4f2d-a99d-731716b4b875" containerName="istio-proxy"
Jul 08 02:12:41.797610 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.797601    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc5b17d-3c35-4f2d-a99d-731716b4b875" containerName="istio-proxy"
Jul 08 02:12:41.800605 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.800588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.804287 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.804266    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b7e0fb27-openshift-default-dockercfg-zvrcl\""
Jul 08 02:12:41.850340 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-data\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.850604 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-certs\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.850604 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850413    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-socket\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.850604 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-envoy\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.850604 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aefa057f-6754-49b3-b49c-58e110809b99-istiod-ca-cert\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.850604 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dsxg\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-kube-api-access-8dsxg\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.850604 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aefa057f-6754-49b3-b49c-58e110809b99-istio-podinfo\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.851080 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-istio-token\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.851080 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.850769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-credential-socket\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.863334 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.863303    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:41.887005 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.886971    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"]
Jul 08 02:12:41.952172 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952118    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aefa057f-6754-49b3-b49c-58e110809b99-istio-podinfo\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952384 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-istio-token\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952384 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-credential-socket\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952509 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-data\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952509 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-certs\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952509 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-socket\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952509 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-envoy\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952754 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aefa057f-6754-49b3-b49c-58e110809b99-istiod-ca-cert\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952754 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952551    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsxg\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-kube-api-access-8dsxg\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952754 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952664    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-credential-socket\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.952946 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952922    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-certs\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.953021 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.952951    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-socket\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.953074 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.953039    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-data\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.953328 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.953310    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aefa057f-6754-49b3-b49c-58e110809b99-istiod-ca-cert\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.954722 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.954683    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aefa057f-6754-49b3-b49c-58e110809b99-istio-podinfo\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.954833 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.954689    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-envoy\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.961232 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.961211    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dsxg\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-kube-api-access-8dsxg\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.961407 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.961390    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-istio-token\") pod \"e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") " pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:41.972837 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:41.972795    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:42.114593 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:42.114502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:42.261368 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:42.261327    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"]
Jul 08 02:12:42.263126 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:12:42.263100    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefa057f_6754_49b3_b49c_58e110809b99.slice/crio-a9d62ce988e3b7a3ef2e84dcd28cfaab44e575d3fabefe2fd167c782992f7bc9 WatchSource:0}: Error finding container a9d62ce988e3b7a3ef2e84dcd28cfaab44e575d3fabefe2fd167c782992f7bc9: Status 404 returned error can't find the container with id a9d62ce988e3b7a3ef2e84dcd28cfaab44e575d3fabefe2fd167c782992f7bc9
Jul 08 02:12:42.265468 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:42.265423    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:12:42.265563 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:42.265520    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:12:42.265606 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:42.265562    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:12:42.356327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:42.356296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" event={"ID":"aefa057f-6754-49b3-b49c-58e110809b99","Type":"ContainerStarted","Data":"e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176"}
Jul 08 02:12:42.356495 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:42.356345    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" event={"ID":"aefa057f-6754-49b3-b49c-58e110809b99","Type":"ContainerStarted","Data":"a9d62ce988e3b7a3ef2e84dcd28cfaab44e575d3fabefe2fd167c782992f7bc9"}
Jul 08 02:12:42.381702 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:42.381249    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" podStartSLOduration=1.381225845 podStartE2EDuration="1.381225845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:12:42.380594791 +0000 UTC m=+1824.746428514" watchObservedRunningTime="2026-07-08 02:12:42.381225845 +0000 UTC m=+1824.747059568"
Jul 08 02:12:43.115726 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:43.115675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:43.121093 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:43.121065    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:43.361535 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:43.361504    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:43.362617 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:43.362575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:12:44.488597 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:44.488556    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:44.596191 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:44.596155    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:44.691685 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:44.691652    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:44.933769 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:44.933637    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:45.276276 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:45.276237    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:45.373890 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:45.373857    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:48.986390 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:48.986358    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:49.701605 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:49.701569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:49.791909 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:49.791875    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:50.113980 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:50.113855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:55.752981 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:55.752932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:55.853817 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:55.853670    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:56.218840 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:56.218786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:56.561223 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:56.561122    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:56.663082 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:56.663045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:12:58.407302 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:58.405945    2582 patch_prober.go:28] interesting pod/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:33456->10.132.0.56:15021: read: connection reset by peer" start-of-body=
Jul 08 02:12:58.407302 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:58.406011    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:33456->10.132.0.56:15021: read: connection reset by peer"
Jul 08 02:12:58.445278 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:58.445249    2582 generic.go:356] "Generic (PLEG): container finished" podID="aefa057f-6754-49b3-b49c-58e110809b99" containerID="e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176" exitCode=0
Jul 08 02:12:58.445441 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:58.445289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" event={"ID":"aefa057f-6754-49b3-b49c-58e110809b99","Type":"ContainerDied","Data":"e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176"}
Jul 08 02:12:58.445674 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:58.445660    2582 scope.go:117] "RemoveContainer" containerID="e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176"
Jul 08 02:12:58.446673 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:58.446643    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:12:58.446759 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:58.446744    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:12:58.446810 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:58.446776    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:12:59.453448 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:12:59.453397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" event={"ID":"aefa057f-6754-49b3-b49c-58e110809b99","Type":"ContainerStarted","Data":"c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1"}
Jul 08 02:13:00.114862 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:00.114823    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:13:00.115051 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:00.115026    2582 patch_prober.go:28] interesting pod/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 08 02:13:00.115098 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:00.115074    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 08 02:13:01.115546 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:01.115508    2582 patch_prober.go:28] interesting pod/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 08 02:13:01.115993 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:01.115576    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 08 02:13:02.115391 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:02.115359    2582 patch_prober.go:28] interesting pod/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 08 02:13:02.115563 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:02.115426    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 08 02:13:02.291975 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:02.291893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:02.351634 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:02.351599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:02.547239 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:02.547199    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"]
Jul 08 02:13:02.547533 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:02.547480    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy" containerID="cri-o://c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1" gracePeriod=30
Jul 08 02:13:02.571351 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:02.571316    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:02.924219 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:02.924123    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:03.025963 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:03.025923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:03.162256 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:03.162222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:08.714436 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.714405    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:13:08.833581 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833478    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aefa057f-6754-49b3-b49c-58e110809b99-istiod-ca-cert\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833581 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833525    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-certs\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833581 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-socket\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833581 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833581    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aefa057f-6754-49b3-b49c-58e110809b99-istio-podinfo\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833934 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833625    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-envoy\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833934 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833658    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dsxg\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-kube-api-access-8dsxg\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833934 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833682    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-credential-socket\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833934 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833766    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-data\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833934 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833846    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-istio-token\") pod \"aefa057f-6754-49b3-b49c-58e110809b99\" (UID: \"aefa057f-6754-49b3-b49c-58e110809b99\") "
Jul 08 02:13:08.833934 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833909    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:13:08.834230 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833951    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:13:08.834230 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.833979    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aefa057f-6754-49b3-b49c-58e110809b99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:13:08.834230 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.834094    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:13:08.834371 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.834283    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aefa057f-6754-49b3-b49c-58e110809b99-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:08.834371 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.834304    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:08.834371 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.834317    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:08.834371 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.834332    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:08.834799 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.834771    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-data" (OuterVolumeSpecName: "istio-data") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:13:08.836099 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.836064    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aefa057f-6754-49b3-b49c-58e110809b99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:13:08.836099 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.836093    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-istio-token" (OuterVolumeSpecName: "istio-token") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:13:08.836234 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.836089    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:13:08.836234 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.836110    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-kube-api-access-8dsxg" (OuterVolumeSpecName: "kube-api-access-8dsxg") pod "aefa057f-6754-49b3-b49c-58e110809b99" (UID: "aefa057f-6754-49b3-b49c-58e110809b99"). InnerVolumeSpecName "kube-api-access-8dsxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:13:08.935486 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.935450    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:08.935486 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.935482    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:08.935486 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.935491    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aefa057f-6754-49b3-b49c-58e110809b99-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:08.935755 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.935499    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aefa057f-6754-49b3-b49c-58e110809b99-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:08.935755 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:08.935509    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dsxg\" (UniqueName: \"kubernetes.io/projected/aefa057f-6754-49b3-b49c-58e110809b99-kube-api-access-8dsxg\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:13:09.179008 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.178929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:09.506883 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.506850    2582 generic.go:356] "Generic (PLEG): container finished" podID="aefa057f-6754-49b3-b49c-58e110809b99" containerID="c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1" exitCode=0
Jul 08 02:13:09.507093 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.506901    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"
Jul 08 02:13:09.507093 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.506927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" event={"ID":"aefa057f-6754-49b3-b49c-58e110809b99","Type":"ContainerDied","Data":"c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1"}
Jul 08 02:13:09.507093 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.506987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6" event={"ID":"aefa057f-6754-49b3-b49c-58e110809b99","Type":"ContainerDied","Data":"a9d62ce988e3b7a3ef2e84dcd28cfaab44e575d3fabefe2fd167c782992f7bc9"}
Jul 08 02:13:09.507093 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.507010    2582 scope.go:117] "RemoveContainer" containerID="c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1"
Jul 08 02:13:09.516735 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.516689    2582 scope.go:117] "RemoveContainer" containerID="e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176"
Jul 08 02:13:09.525496 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.525475    2582 scope.go:117] "RemoveContainer" containerID="c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1"
Jul 08 02:13:09.525865 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:13:09.525842    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1\": container with ID starting with c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1 not found: ID does not exist" containerID="c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1"
Jul 08 02:13:09.525936 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.525875    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1"} err="failed to get container status \"c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1\": rpc error: code = NotFound desc = could not find container \"c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1\": container with ID starting with c656a613946ce92e1fce76a114e5b39b4fb0c98d7e703073a0ed728a1a2863f1 not found: ID does not exist"
Jul 08 02:13:09.525936 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.525894    2582 scope.go:117] "RemoveContainer" containerID="e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176"
Jul 08 02:13:09.526109 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:13:09.526093    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176\": container with ID starting with e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176 not found: ID does not exist" containerID="e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176"
Jul 08 02:13:09.526159 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.526115    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176"} err="failed to get container status \"e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176\": rpc error: code = NotFound desc = could not find container \"e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176\": container with ID starting with e3d761144384bd2499ba390481f51c34c03079ae69c2dbd5f49f72fb5e10b176 not found: ID does not exist"
Jul 08 02:13:09.532349 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.532325    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"]
Jul 08 02:13:09.536375 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:09.536353    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b7e0fb27-openshift-default-64cdcbd647-8j5b6"]
Jul 08 02:13:10.165953 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:10.165919    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aefa057f-6754-49b3-b49c-58e110809b99" path="/var/lib/kubelet/pods/aefa057f-6754-49b3-b49c-58e110809b99/volumes"
Jul 08 02:13:10.596095 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:10.596062    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:15.283898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:15.283865    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:15.387196 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:15.387153    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:22.084121 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.084069    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:22.370284 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.370188    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"]
Jul 08 02:13:22.370822 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.370799    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy"
Jul 08 02:13:22.370822 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.370822    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy"
Jul 08 02:13:22.371031 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.370933    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy"
Jul 08 02:13:22.374187 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.374167    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.377010 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.376985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b64edcbf-openshift-default-dockercfg-tt5rn\""
Jul 08 02:13:22.385992 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.385966    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"]
Jul 08 02:13:22.396794 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.396764    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:22.459529 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-socket\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.459730 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvk7\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-kube-api-access-lqvk7\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.459730 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-istio-token\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.459730 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-certs\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.459874 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-data\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.459874 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-envoy\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.459874 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459859    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cd58800-a663-4ae6-b139-e9b8411df266-istiod-ca-cert\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.459987 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-credential-socket\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.459987 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.459917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cd58800-a663-4ae6-b139-e9b8411df266-istio-podinfo\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.560969 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.560927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-istio-token\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561181 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.560979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-certs\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561181 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-data\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561181 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-envoy\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561181 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cd58800-a663-4ae6-b139-e9b8411df266-istiod-ca-cert\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561181 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-credential-socket\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561181 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cd58800-a663-4ae6-b139-e9b8411df266-istio-podinfo\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561494 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-socket\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561494 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvk7\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-kube-api-access-lqvk7\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561494 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561420    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-certs\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561494 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561431    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-data\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561659 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561580    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-credential-socket\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561659 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561622    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-socket\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.561890 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.561867    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cd58800-a663-4ae6-b139-e9b8411df266-istiod-ca-cert\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.563517 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.563494    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-envoy\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.563877 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.563855    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cd58800-a663-4ae6-b139-e9b8411df266-istio-podinfo\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.574638 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.574601    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-istio-token\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.574638 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.574621    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvk7\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-kube-api-access-lqvk7\") pod \"e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") " pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.637039 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.636951    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:22.686983 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.686944    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:22.834845 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.834822    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"]
Jul 08 02:13:22.836685 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:13:22.836658    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd58800_a663_4ae6_b139_e9b8411df266.slice/crio-58d3bc36d80109df0da25338d29153a84f1831a825bfa6a9719046c23c42c4c4 WatchSource:0}: Error finding container 58d3bc36d80109df0da25338d29153a84f1831a825bfa6a9719046c23c42c4c4: Status 404 returned error can't find the container with id 58d3bc36d80109df0da25338d29153a84f1831a825bfa6a9719046c23c42c4c4
Jul 08 02:13:22.838866 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.838834    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:13:22.838931 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.838899    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:13:22.838973 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:22.838943    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:13:23.577666 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:23.577625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" event={"ID":"7cd58800-a663-4ae6-b139-e9b8411df266","Type":"ContainerStarted","Data":"796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe"}
Jul 08 02:13:23.578162 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:23.577683    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" event={"ID":"7cd58800-a663-4ae6-b139-e9b8411df266","Type":"ContainerStarted","Data":"58d3bc36d80109df0da25338d29153a84f1831a825bfa6a9719046c23c42c4c4"}
Jul 08 02:13:23.601828 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:23.601781    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" podStartSLOduration=1.601766018 podStartE2EDuration="1.601766018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:13:23.599377857 +0000 UTC m=+1865.965211582" watchObservedRunningTime="2026-07-08 02:13:23.601766018 +0000 UTC m=+1865.967599739"
Jul 08 02:13:23.687531 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:23.687493    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:23.692573 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:23.692547    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:24.585033 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:24.584996    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:24.586139 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:24.586115    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:25.530459 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:25.530427    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:25.630290 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:25.630253    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:25.774182 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:25.774152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:26.193397 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:26.193363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:26.300763 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:26.300699    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:26.401359 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:26.401329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:30.033564 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:30.033529    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:39.587358 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:39.587272    2582 patch_prober.go:28] interesting pod/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 08 02:13:39.587358 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:39.587330    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 08 02:13:39.669468 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:39.669435    2582 generic.go:356] "Generic (PLEG): container finished" podID="7cd58800-a663-4ae6-b139-e9b8411df266" containerID="796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe" exitCode=0
Jul 08 02:13:39.669468 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:39.669491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" event={"ID":"7cd58800-a663-4ae6-b139-e9b8411df266","Type":"ContainerDied","Data":"796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe"}
Jul 08 02:13:39.670015 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:39.669994    2582 scope.go:117] "RemoveContainer" containerID="796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe"
Jul 08 02:13:39.671156 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:39.671127    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:13:39.671211 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:39.671195    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:13:39.671246 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:39.671227    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:13:40.691924 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:40.677814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" event={"ID":"7cd58800-a663-4ae6-b139-e9b8411df266","Type":"ContainerStarted","Data":"72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f"}
Jul 08 02:13:40.691924 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:40.690004    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:40.691924 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:40.690397    2582 patch_prober.go:28] interesting pod/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 08 02:13:40.691924 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:40.690446    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 08 02:13:41.690884 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:41.690844    2582 patch_prober.go:28] interesting pod/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 08 02:13:41.691196 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:41.691164    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 08 02:13:42.688386 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:42.688346    2582 patch_prober.go:28] interesting pod/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 08 02:13:42.688927 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:42.688417    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 08 02:13:43.691184 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:43.691145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:13:43.692274 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:43.692249    2582 patch_prober.go:28] interesting pod/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 08 02:13:43.692473 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:43.692449    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 08 02:13:44.692014 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:44.691983    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:44.692429 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:44.692246    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:13:44.693094 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:13:44.693077    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:14:07.796502 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:14:07.796462    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:14:08.192417 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:14:08.192387    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:14:13.802803 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:14:13.802761    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:14:18.865276 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:14:18.865233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:14:55.365395 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:14:55.365358    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:14:55.781875 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:14:55.781836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:01.205060 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:01.205020    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:01.272541 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:01.272498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:01.473583 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:01.473473    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"]
Jul 08 02:15:01.473795 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:01.473694    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy" containerID="cri-o://72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f" gracePeriod=30
Jul 08 02:15:01.761448 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:01.761364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:02.779191 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:02.779153    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:02.878978 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:02.878944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:02.979297 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:02.979261    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:03.725345 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:03.725305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:03.974569 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:03.974527    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:04.074300 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:04.074217    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:06.745822 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.745737    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:15:06.837387 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837340    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqvk7\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-kube-api-access-lqvk7\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.837573 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837395    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-socket\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.837573 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837473    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-data\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.837573 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837499    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-certs\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.837573 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837528    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cd58800-a663-4ae6-b139-e9b8411df266-istiod-ca-cert\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.837850 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837576    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cd58800-a663-4ae6-b139-e9b8411df266-istio-podinfo\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.837850 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-credential-socket\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.837850 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837793    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:15:06.838016 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837924    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:15:06.838016 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.837989    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cd58800-a663-4ae6-b139-e9b8411df266-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:15:06.838128 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.838021    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:15:06.838250 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.838223    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-istio-token\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.838395 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.838282    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-envoy\") pod \"7cd58800-a663-4ae6-b139-e9b8411df266\" (UID: \"7cd58800-a663-4ae6-b139-e9b8411df266\") "
Jul 08 02:15:06.838539 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.838508    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-data" (OuterVolumeSpecName: "istio-data") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:15:06.838646 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.838515    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:06.838646 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.838574    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cd58800-a663-4ae6-b139-e9b8411df266-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:06.838646 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.838592    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:06.838646 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.838610    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:06.839764 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.839741    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-kube-api-access-lqvk7" (OuterVolumeSpecName: "kube-api-access-lqvk7") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "kube-api-access-lqvk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:15:06.840197 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.840167    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-istio-token" (OuterVolumeSpecName: "istio-token") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:15:06.840320 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.840203    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cd58800-a663-4ae6-b139-e9b8411df266-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:15:06.840515 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.840500    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7cd58800-a663-4ae6-b139-e9b8411df266" (UID: "7cd58800-a663-4ae6-b139-e9b8411df266"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:15:06.940092 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.940050    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:06.940092 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.940083    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cd58800-a663-4ae6-b139-e9b8411df266-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:06.940092 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.940092    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:06.940092 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.940100    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cd58800-a663-4ae6-b139-e9b8411df266-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:06.940375 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:06.940109    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqvk7\" (UniqueName: \"kubernetes.io/projected/7cd58800-a663-4ae6-b139-e9b8411df266-kube-api-access-lqvk7\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:15:07.138598 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.138500    2582 generic.go:356] "Generic (PLEG): container finished" podID="7cd58800-a663-4ae6-b139-e9b8411df266" containerID="72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f" exitCode=0
Jul 08 02:15:07.138598 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.138568    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"
Jul 08 02:15:07.138839 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.138590    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" event={"ID":"7cd58800-a663-4ae6-b139-e9b8411df266","Type":"ContainerDied","Data":"72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f"}
Jul 08 02:15:07.138839 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.138678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp" event={"ID":"7cd58800-a663-4ae6-b139-e9b8411df266","Type":"ContainerDied","Data":"58d3bc36d80109df0da25338d29153a84f1831a825bfa6a9719046c23c42c4c4"}
Jul 08 02:15:07.138839 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.138701    2582 scope.go:117] "RemoveContainer" containerID="72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f"
Jul 08 02:15:07.148760 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.148737    2582 scope.go:117] "RemoveContainer" containerID="796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe"
Jul 08 02:15:07.158694 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.158666    2582 scope.go:117] "RemoveContainer" containerID="72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f"
Jul 08 02:15:07.159128 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:15:07.159093    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f\": container with ID starting with 72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f not found: ID does not exist" containerID="72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f"
Jul 08 02:15:07.159260 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.159129    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f"} err="failed to get container status \"72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f\": rpc error: code = NotFound desc = could not find container \"72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f\": container with ID starting with 72827e3f6b2a7e7d5ef39b7d26d5b04b76cb09a2ecc553cdbb619dce30bac18f not found: ID does not exist"
Jul 08 02:15:07.159260 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.159149    2582 scope.go:117] "RemoveContainer" containerID="796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe"
Jul 08 02:15:07.159572 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:15:07.159515    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe\": container with ID starting with 796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe not found: ID does not exist" containerID="796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe"
Jul 08 02:15:07.159572 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.159549    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe"} err="failed to get container status \"796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe\": rpc error: code = NotFound desc = could not find container \"796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe\": container with ID starting with 796ea47960079a6f353477733b8e50b2e78ab738206f6a5b46711435d621ccbe not found: ID does not exist"
Jul 08 02:15:07.162177 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.162154    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"]
Jul 08 02:15:07.165499 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:07.165468    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b64edcbf-openshift-default-59b69576c-5jvgp"]
Jul 08 02:15:08.165575 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:08.165535    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" path="/var/lib/kubelet/pods/7cd58800-a663-4ae6-b139-e9b8411df266/volumes"
Jul 08 02:15:35.221830 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:35.221794    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:41.044113 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:41.044075    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:46.673229 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:46.673184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:15:46.747568 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:15:46.747533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:17.317844 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:17.317808    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:23.290135 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:23.290097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:23.393495 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:23.393459    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:23.491739 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:23.491695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:28.972751 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:28.972681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:29.037500 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:29.037466    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:29.120487 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:29.120456    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:29.214445 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:29.214411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:39.752927 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:39.752893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:40.079603 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:40.079516    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:43.849157 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:43.849119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:50.119033 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:50.118990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:16:50.220760 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:16:50.220690    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:01.096302 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:01.096260    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:06.910900 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:06.910862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:07.006946 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.006871    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:07.273678 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.273643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:07.743971 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.743937    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"]
Jul 08 02:17:07.744350 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.744338    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy"
Jul 08 02:17:07.744350 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.744351    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy"
Jul 08 02:17:07.744477 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.744366    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy"
Jul 08 02:17:07.744477 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.744371    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy"
Jul 08 02:17:07.744477 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.744448    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy"
Jul 08 02:17:07.744477 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.744459    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aefa057f-6754-49b3-b49c-58e110809b99" containerName="istio-proxy"
Jul 08 02:17:07.747668 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.747647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.751561 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.751540    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7c26aa-openshift-default-dockercfg-sd6mm\""
Jul 08 02:17:07.769094 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.769060    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"]
Jul 08 02:17:07.792166 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.792118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:07.857836 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.857799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-token\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.858023 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.857866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-data\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.858023 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.857900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-envoy\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.858023 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.857918    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-podinfo\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.858023 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.857965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k4h7\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-kube-api-access-8k4h7\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.858023 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.858015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e505f7-c1a1-4008-b55e-76a5d2480697-istiod-ca-cert\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.858195 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.858055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-certs\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.858195 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.858139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-credential-socket\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.858195 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.858173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-socket\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.883943 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.883888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:07.959313 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-data\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959313 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-envoy\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959878 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-podinfo\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959878 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k4h7\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-kube-api-access-8k4h7\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959878 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e505f7-c1a1-4008-b55e-76a5d2480697-istiod-ca-cert\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959878 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-certs\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959878 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-credential-socket\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959878 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-socket\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959878 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959754    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-data\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.959878 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-token\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.960259 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.959986    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-certs\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.960259 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.960154    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-socket\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.960259 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.960200    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-credential-socket\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.960389 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.960364    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e505f7-c1a1-4008-b55e-76a5d2480697-istiod-ca-cert\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.961844 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.961824    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-envoy\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.962053 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.962038    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-podinfo\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.969101 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.969068    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-token\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:07.969276 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:07.969255    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k4h7\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-kube-api-access-8k4h7\") pod \"e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") " pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:08.058557 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:08.058465    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:08.209229 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:08.209201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"]
Jul 08 02:17:08.213403 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:17:08.213339    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e505f7_c1a1_4008_b55e_76a5d2480697.slice/crio-2bcac62c7981d2ecd4502581a21d6fc628b0e5d64b7d7bfbfb972be0d610c1e6 WatchSource:0}: Error finding container 2bcac62c7981d2ecd4502581a21d6fc628b0e5d64b7d7bfbfb972be0d610c1e6: Status 404 returned error can't find the container with id 2bcac62c7981d2ecd4502581a21d6fc628b0e5d64b7d7bfbfb972be0d610c1e6
Jul 08 02:17:08.215065 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:08.215032    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:17:08.215145 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:08.215105    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:17:08.215184 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:08.215160    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:17:08.757680 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:08.757640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" event={"ID":"a5e505f7-c1a1-4008-b55e-76a5d2480697","Type":"ContainerStarted","Data":"4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241"}
Jul 08 02:17:08.757924 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:08.757694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" event={"ID":"a5e505f7-c1a1-4008-b55e-76a5d2480697","Type":"ContainerStarted","Data":"2bcac62c7981d2ecd4502581a21d6fc628b0e5d64b7d7bfbfb972be0d610c1e6"}
Jul 08 02:17:08.779965 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:08.779913    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" podStartSLOduration=1.779894791 podStartE2EDuration="1.779894791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:17:08.778308948 +0000 UTC m=+2091.144142676" watchObservedRunningTime="2026-07-08 02:17:08.779894791 +0000 UTC m=+2091.145728524"
Jul 08 02:17:09.059254 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:09.059164    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:09.064535 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:09.064502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:09.762584 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:09.762548    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:09.763760 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:09.763741    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:10.703260 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:10.703228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:10.774633 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:10.774599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:10.850656 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:10.850603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:11.267111 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:11.267075    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:11.366974 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:11.366933    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:15.224531 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:15.224489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:15.562602 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:15.562510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:15.991992 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:15.991961    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:16.152590 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:16.152552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:18.272698 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:18.272669    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:17:18.284938 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:18.284910    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:17:18.889159 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:18.889114    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:18.970059 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:18.970018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:19.037052 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:19.037004    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:19.142033 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:19.141945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:19.519372 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:19.519338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:19.621687 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:19.621653    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:23.388084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:23.388042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:25.803931 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:25.803884    2582 patch_prober.go:28] interesting pod/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 02:17:25.804343 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:25.803951    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 02:17:27.857937 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:27.857904    2582 generic.go:356] "Generic (PLEG): container finished" podID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerID="4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241" exitCode=0
Jul 08 02:17:27.858428 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:27.857978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" event={"ID":"a5e505f7-c1a1-4008-b55e-76a5d2480697","Type":"ContainerDied","Data":"4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241"}
Jul 08 02:17:27.858428 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:27.858337    2582 scope.go:117] "RemoveContainer" containerID="4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241"
Jul 08 02:17:27.859418 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:27.859386    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:17:27.859514 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:27.859454    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:17:27.859514 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:27.859487    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:17:28.865538 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:28.865506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" event={"ID":"a5e505f7-c1a1-4008-b55e-76a5d2480697","Type":"ContainerStarted","Data":"8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378"}
Jul 08 02:17:29.058848 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:29.058808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:29.059123 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:29.059097    2582 patch_prober.go:28] interesting pod/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 08 02:17:29.059204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:29.059159    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 08 02:17:30.059668 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:30.059631    2582 patch_prober.go:28] interesting pod/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 08 02:17:30.060125 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:30.059688    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 08 02:17:31.059133 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:31.059097    2582 patch_prober.go:28] interesting pod/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 08 02:17:31.059318 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:31.059154    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 08 02:17:32.041225 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:32.041198    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:32.059440 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:32.059405    2582 patch_prober.go:28] interesting pod/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 08 02:17:32.059612 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:32.059462    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 08 02:17:32.140611 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:32.140573    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:33.062161 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:33.062130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:33.062589 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:33.062411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:33.063136 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:33.063115    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:17:39.759310 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:39.759273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:40.215375 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:40.215341    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:17:40.321802 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:17:40.321764    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:13.975945 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:13.975864    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:47.088771 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.088733    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:47.399455 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.399375    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"]
Jul 08 02:18:47.399998 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.399975    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy"
Jul 08 02:18:47.400137 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.400028    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy"
Jul 08 02:18:47.400210 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.400152    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd58800-a663-4ae6-b139-e9b8411df266" containerName="istio-proxy"
Jul 08 02:18:47.403366 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.403345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.406510 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.406491    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-f124b1-openshift-default-dockercfg-c6r4z\""
Jul 08 02:18:47.423307 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.423283    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"]
Jul 08 02:18:47.437247 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.437218    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:47.500168 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-credential-socket\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.500168 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500179    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-token\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.500410 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-podinfo\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.500410 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-certs\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.500410 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-data\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.500577 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-envoy\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.500577 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istiod-ca-cert\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.500577 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-socket\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.500692 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.500592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2mn\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-kube-api-access-tr2mn\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.582702 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.582666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.602656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-credential-socket\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.602743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-token\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.602781    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-podinfo\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.602813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-certs\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.602857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-data\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.602918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-envoy\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.602958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istiod-ca-cert\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.602999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-socket\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.603039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2mn\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-kube-api-access-tr2mn\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.603738    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-credential-socket\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.604084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.603827    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-data\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.605149 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.605128    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-certs\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.605964 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.605944    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istiod-ca-cert\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.606327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.606302    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-socket\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.608764 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.608330    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-envoy\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.610807 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.610787    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-podinfo\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.614825 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.614806    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-token\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.615623 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.615603    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2mn\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-kube-api-access-tr2mn\") pod \"e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") " pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.713648 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.713610    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:47.856142 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.856113    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"]
Jul 08 02:18:47.857961 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:18:47.857933    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6717168b_dad2_46d6_be0e_5b08bc4a4c00.slice/crio-dc5cd1413cdd9cc10e493e435a849aaa5185eec89e7d8cc1b565d5f25e9c13d9 WatchSource:0}: Error finding container dc5cd1413cdd9cc10e493e435a849aaa5185eec89e7d8cc1b565d5f25e9c13d9: Status 404 returned error can't find the container with id dc5cd1413cdd9cc10e493e435a849aaa5185eec89e7d8cc1b565d5f25e9c13d9
Jul 08 02:18:47.860313 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.860278    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:18:47.860439 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.860360    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:18:47.860439 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:47.860408    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:18:48.298582 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:48.298546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" event={"ID":"6717168b-dad2-46d6-be0e-5b08bc4a4c00","Type":"ContainerStarted","Data":"2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2"}
Jul 08 02:18:48.299003 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:48.298612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" event={"ID":"6717168b-dad2-46d6-be0e-5b08bc4a4c00","Type":"ContainerStarted","Data":"dc5cd1413cdd9cc10e493e435a849aaa5185eec89e7d8cc1b565d5f25e9c13d9"}
Jul 08 02:18:48.322856 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:48.322814    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" podStartSLOduration=1.322798433 podStartE2EDuration="1.322798433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:18:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:18:48.321653451 +0000 UTC m=+2190.687487177" watchObservedRunningTime="2026-07-08 02:18:48.322798433 +0000 UTC m=+2190.688632154"
Jul 08 02:18:48.714180 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:48.714146    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:48.719645 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:48.719614    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:49.304533 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:49.304502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:49.305456 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:49.305438    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:18:50.262325 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:50.262289    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:50.352588 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:50.352549    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:50.422665 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:50.422635    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:50.856060 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:50.856018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:50.986543 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:50.986495    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:51.084451 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:51.084412    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:18:54.789585 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:18:54.789549    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:19:00.650839 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:00.650799    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:19:13.435326 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:13.435292    2582 generic.go:356] "Generic (PLEG): container finished" podID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerID="2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2" exitCode=0
Jul 08 02:19:13.435769 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:13.435368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" event={"ID":"6717168b-dad2-46d6-be0e-5b08bc4a4c00","Type":"ContainerDied","Data":"2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2"}
Jul 08 02:19:13.435828 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:13.435819    2582 scope.go:117] "RemoveContainer" containerID="2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2"
Jul 08 02:19:13.436859 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:13.436826    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:19:13.436972 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:13.436898    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:19:13.436972 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:13.436939    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:19:14.448824 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:14.448761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" event={"ID":"6717168b-dad2-46d6-be0e-5b08bc4a4c00","Type":"ContainerStarted","Data":"30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5"}
Jul 08 02:19:14.714801 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:14.714683    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:19:14.716060 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:14.716033    2582 patch_prober.go:28] interesting pod/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 08 02:19:14.716182 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:14.716090    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 08 02:19:15.714350 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:15.714310    2582 patch_prober.go:28] interesting pod/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 08 02:19:15.714797 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:15.714368    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 08 02:19:16.671289 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:16.671256    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:19:16.714198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:16.714163    2582 patch_prober.go:28] interesting pod/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 08 02:19:16.714378 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:16.714216    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 08 02:19:17.152888 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:17.152852    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:19:17.272597 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:17.272565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:19:17.714092 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:17.714050    2582 patch_prober.go:28] interesting pod/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 08 02:19:17.714280 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:17.714117    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 08 02:19:18.718315 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:18.718280    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:19:18.718817 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:18.718664    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:19:18.719398 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:18.719380    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:19:22.219512 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:22.219481    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:19:58.762456 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:58.762426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:19:59.590643 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:19:59.590612    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:05.103254 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:05.103216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:28.677684 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:28.677649    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:28.772347 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:28.772318    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:28.968930 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:28.968893    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"]
Jul 08 02:20:28.969159 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:28.969118    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy" containerID="cri-o://30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5" gracePeriod=30
Jul 08 02:20:28.980171 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:28.980141    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:30.123371 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:30.123335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:31.047589 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:31.047549    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:31.352251 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:31.352163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:31.606391 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:31.606300    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:31.704073 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:31.704041    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:31.805269 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:31.805239    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:31.905350 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:31.905267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:33.721036 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:33.720999    2582 patch_prober.go:28] interesting pod/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 02:20:33.721416 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:33.721059    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 02:20:34.227864 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.227803    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:20:34.361612 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361580    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-certs\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.361612 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361618    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-envoy\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.361898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361699    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-credential-socket\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.361898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361742    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-socket\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.361898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361766    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-data\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.361898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361801    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-token\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.361898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361827    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istiod-ca-cert\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.361898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361847    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-podinfo\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.361898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361885    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr2mn\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-kube-api-access-tr2mn\") pod \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\" (UID: \"6717168b-dad2-46d6-be0e-5b08bc4a4c00\") "
Jul 08 02:20:34.362264 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361952    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:20:34.362264 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.361969    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:20:34.362264 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.362063    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:20:34.362264 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.362245    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.362264 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.362257    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:20:34.362521 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.362262    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.362521 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.362300    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.363166 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.363133    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-data" (OuterVolumeSpecName: "istio-data") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:20:34.364038 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.364008    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-token" (OuterVolumeSpecName: "istio-token") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:20:34.364156 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.364134    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:20:34.364204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.364165    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:20:34.364204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.364171    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-kube-api-access-tr2mn" (OuterVolumeSpecName: "kube-api-access-tr2mn") pod "6717168b-dad2-46d6-be0e-5b08bc4a4c00" (UID: "6717168b-dad2-46d6-be0e-5b08bc4a4c00"). InnerVolumeSpecName "kube-api-access-tr2mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:20:34.463145 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.463102    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.463145 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.463143    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.463362 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.463157    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.463362 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.463170    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr2mn\" (UniqueName: \"kubernetes.io/projected/6717168b-dad2-46d6-be0e-5b08bc4a4c00-kube-api-access-tr2mn\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.463362 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.463181    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.463362 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.463189    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6717168b-dad2-46d6-be0e-5b08bc4a4c00-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:20:34.601053 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.600970    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:34.664865 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.664832    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:20:34.873269 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.873182    2582 generic.go:356] "Generic (PLEG): container finished" podID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerID="30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5" exitCode=0
Jul 08 02:20:34.873269 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.873229    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"
Jul 08 02:20:34.873740 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.873268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" event={"ID":"6717168b-dad2-46d6-be0e-5b08bc4a4c00","Type":"ContainerDied","Data":"30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5"}
Jul 08 02:20:34.873740 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.873325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv" event={"ID":"6717168b-dad2-46d6-be0e-5b08bc4a4c00","Type":"ContainerDied","Data":"dc5cd1413cdd9cc10e493e435a849aaa5185eec89e7d8cc1b565d5f25e9c13d9"}
Jul 08 02:20:34.873740 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.873349    2582 scope.go:117] "RemoveContainer" containerID="30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5"
Jul 08 02:20:34.883857 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.883838    2582 scope.go:117] "RemoveContainer" containerID="2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2"
Jul 08 02:20:34.892839 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.892821    2582 scope.go:117] "RemoveContainer" containerID="30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5"
Jul 08 02:20:34.893124 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:20:34.893104    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5\": container with ID starting with 30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5 not found: ID does not exist" containerID="30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5"
Jul 08 02:20:34.893191 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.893139    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5"} err="failed to get container status \"30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5\": rpc error: code = NotFound desc = could not find container \"30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5\": container with ID starting with 30df0b7434a881b07c9c711acf2582fa6251378e04437190456d30c2dac947d5 not found: ID does not exist"
Jul 08 02:20:34.893191 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.893164    2582 scope.go:117] "RemoveContainer" containerID="2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2"
Jul 08 02:20:34.893423 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:20:34.893406    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2\": container with ID starting with 2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2 not found: ID does not exist" containerID="2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2"
Jul 08 02:20:34.893465 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.893429    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2"} err="failed to get container status \"2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2\": rpc error: code = NotFound desc = could not find container \"2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2\": container with ID starting with 2029870b0879bb8a48cc788cdddcedfcb9504207dd0426bf8a8c9971734346e2 not found: ID does not exist"
Jul 08 02:20:34.898907 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.898884    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"]
Jul 08 02:20:34.905518 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:34.905495    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-f124b1-openshift-default-597b8f4fbc-b4lfv"]
Jul 08 02:20:36.166439 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:36.166402    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" path="/var/lib/kubelet/pods/6717168b-dad2-46d6-be0e-5b08bc4a4c00/volumes"
Jul 08 02:20:36.685836 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:20:36.685802    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:13.381059 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:13.380971    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:13.648293 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:13.648207    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"]
Jul 08 02:21:13.648454 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:13.648429    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy" containerID="cri-o://8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378" gracePeriod=30
Jul 08 02:21:13.667259 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:13.667233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:14.217967 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:14.217930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:14.582149 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:14.582064    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:14.682514 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:14.682479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:14.783412 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:14.783365    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:14.898422 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:14.898348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:18.064763 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.064726    2582 patch_prober.go:28] interesting pod/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 02:21:18.065205 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.064782    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 02:21:18.913364 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.913336    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:21:18.973543 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973497    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-socket\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.973543 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-podinfo\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.973835 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973564    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-token\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.973835 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973618    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-credential-socket\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.973835 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973646    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-envoy\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.973835 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973694    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-data\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.973835 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973810    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-certs\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.974221 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973863    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:18.974221 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.973848    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e505f7-c1a1-4008-b55e-76a5d2480697-istiod-ca-cert\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.974221 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974076    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:18.974221 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974163    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k4h7\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-kube-api-access-8k4h7\") pod \"a5e505f7-c1a1-4008-b55e-76a5d2480697\" (UID: \"a5e505f7-c1a1-4008-b55e-76a5d2480697\") "
Jul 08 02:21:18.974853 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974328    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:18.974853 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974400    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e505f7-c1a1-4008-b55e-76a5d2480697-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:21:18.974853 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974643    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:18.974853 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974664    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e505f7-c1a1-4008-b55e-76a5d2480697-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:18.974853 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974677    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:18.974853 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974691    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:18.975173 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.974864    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:18.976342 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.976316    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:21:18.976682 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.976660    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:21:18.976874 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.976681    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-kube-api-access-8k4h7" (OuterVolumeSpecName: "kube-api-access-8k4h7") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "kube-api-access-8k4h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:21:18.976874 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:18.976779    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5e505f7-c1a1-4008-b55e-76a5d2480697" (UID: "a5e505f7-c1a1-4008-b55e-76a5d2480697"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:19.076169 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.076136    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:19.076169 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.076161    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:19.076169 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.076171    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k4h7\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-kube-api-access-8k4h7\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:19.076596 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.076180    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:19.076596 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.076190    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e505f7-c1a1-4008-b55e-76a5d2480697-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:19.117543 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.117513    2582 generic.go:356] "Generic (PLEG): container finished" podID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerID="8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378" exitCode=0
Jul 08 02:21:19.117734 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.117551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" event={"ID":"a5e505f7-c1a1-4008-b55e-76a5d2480697","Type":"ContainerDied","Data":"8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378"}
Jul 08 02:21:19.117734 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.117560    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"
Jul 08 02:21:19.117734 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.117589    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt" event={"ID":"a5e505f7-c1a1-4008-b55e-76a5d2480697","Type":"ContainerDied","Data":"2bcac62c7981d2ecd4502581a21d6fc628b0e5d64b7d7bfbfb972be0d610c1e6"}
Jul 08 02:21:19.117734 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.117610    2582 scope.go:117] "RemoveContainer" containerID="8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378"
Jul 08 02:21:19.127461 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.127444    2582 scope.go:117] "RemoveContainer" containerID="4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241"
Jul 08 02:21:19.135790 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.135771    2582 scope.go:117] "RemoveContainer" containerID="8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378"
Jul 08 02:21:19.136041 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:21:19.136020    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378\": container with ID starting with 8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378 not found: ID does not exist" containerID="8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378"
Jul 08 02:21:19.136091 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.136049    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378"} err="failed to get container status \"8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378\": rpc error: code = NotFound desc = could not find container \"8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378\": container with ID starting with 8a658558ccdd77d5d4683f492aded4c4104e7fc4c3d3a7024e2f6c41d8b26378 not found: ID does not exist"
Jul 08 02:21:19.136091 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.136066    2582 scope.go:117] "RemoveContainer" containerID="4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241"
Jul 08 02:21:19.136269 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:21:19.136254    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241\": container with ID starting with 4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241 not found: ID does not exist" containerID="4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241"
Jul 08 02:21:19.136310 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.136273    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241"} err="failed to get container status \"4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241\": rpc error: code = NotFound desc = could not find container \"4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241\": container with ID starting with 4bcbd35e79a203304d5e92c47482b21f1f6715aeccd6371a0e314c7d22b99241 not found: ID does not exist"
Jul 08 02:21:19.141038 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.141015    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"]
Jul 08 02:21:19.149055 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:19.149021    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7c26aa-openshift-default-846cc6594f-sxkzt"]
Jul 08 02:21:20.166876 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:20.166845    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" path="/var/lib/kubelet/pods/a5e505f7-c1a1-4008-b55e-76a5d2480697/volumes"
Jul 08 02:21:20.424293 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:20.424193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:20.489914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:20.489880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:20.691772 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:20.691741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:21.256967 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.256936    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:21.545217 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545127    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"]
Jul 08 02:21:21.545764 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545745    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy"
Jul 08 02:21:21.545818 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545769    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy"
Jul 08 02:21:21.545818 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545813    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy"
Jul 08 02:21:21.545898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545823    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy"
Jul 08 02:21:21.545898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545838    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy"
Jul 08 02:21:21.545898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545848    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy"
Jul 08 02:21:21.545898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545859    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy"
Jul 08 02:21:21.545898 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545867    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy"
Jul 08 02:21:21.546045 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545959    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy"
Jul 08 02:21:21.546045 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545971    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy"
Jul 08 02:21:21.546045 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545980    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6717168b-dad2-46d6-be0e-5b08bc4a4c00" containerName="istio-proxy"
Jul 08 02:21:21.546045 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.545988    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e505f7-c1a1-4008-b55e-76a5d2480697" containerName="istio-proxy"
Jul 08 02:21:21.549830 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.549804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.552583 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.552559    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-645239-openshift-default-dockercfg-ssxfv\""
Jul 08 02:21:21.558557 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.558532    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"]
Jul 08 02:21:21.565621 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.565592    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:21.600141 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-certs\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.600326 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-data\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.600326 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d9vb\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-kube-api-access-7d9vb\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.600326 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40fbb388-2dc9-44da-8eac-a5ad017858ad-istiod-ca-cert\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.600326 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-socket\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.600478 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-credential-socket\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.600478 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-token\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.600478 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-podinfo\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.600478 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.600418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-envoy\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701587 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701551    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-socket\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701587 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-credential-socket\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-token\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-podinfo\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-envoy\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-certs\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-data\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d9vb\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-kube-api-access-7d9vb\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.701914 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.701884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40fbb388-2dc9-44da-8eac-a5ad017858ad-istiod-ca-cert\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.702316 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.702004    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-credential-socket\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.702316 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.702062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-socket\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.702444 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.702318    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-certs\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.702444 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.702346    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-data\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.702606 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.702582    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40fbb388-2dc9-44da-8eac-a5ad017858ad-istiod-ca-cert\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.703957 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.703933    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-envoy\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.704171 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.704153    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-podinfo\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.710408 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.710381    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-token\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.710532 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.710513    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d9vb\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-kube-api-access-7d9vb\") pod \"e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") " pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:21.717140 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.717113    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:21.862083 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:21.861993    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:22.004985 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:22.004951    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"]
Jul 08 02:21:22.006911 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:21:22.006886    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40fbb388_2dc9_44da_8eac_a5ad017858ad.slice/crio-fd09ef8ae8073050bdc3f913d2aa0ecf88e3f80954f7abd2b2e05c20ef6f728e WatchSource:0}: Error finding container fd09ef8ae8073050bdc3f913d2aa0ecf88e3f80954f7abd2b2e05c20ef6f728e: Status 404 returned error can't find the container with id fd09ef8ae8073050bdc3f913d2aa0ecf88e3f80954f7abd2b2e05c20ef6f728e
Jul 08 02:21:22.009682 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:22.009641    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:21:22.009782 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:22.009759    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:21:22.009826 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:22.009793    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:21:22.136529 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:22.136434    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" event={"ID":"40fbb388-2dc9-44da-8eac-a5ad017858ad","Type":"ContainerStarted","Data":"321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c"}
Jul 08 02:21:22.136529 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:22.136486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" event={"ID":"40fbb388-2dc9-44da-8eac-a5ad017858ad","Type":"ContainerStarted","Data":"fd09ef8ae8073050bdc3f913d2aa0ecf88e3f80954f7abd2b2e05c20ef6f728e"}
Jul 08 02:21:22.156534 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:22.156488    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" podStartSLOduration=1.156473711 podStartE2EDuration="1.156473711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:21:22.154528913 +0000 UTC m=+2344.520362636" watchObservedRunningTime="2026-07-08 02:21:22.156473711 +0000 UTC m=+2344.522307433"
Jul 08 02:21:22.863127 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:22.863080    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:23.867785 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:23.867746    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:24.051416 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:24.051368    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:24.145904 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:24.145810    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:24.147466 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:24.147440    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:24.147765 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:24.147693    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:24.244947 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:24.244913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:24.639553 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:24.639518    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:25.015089 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:25.015057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:25.112937 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:25.112904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:25.213818 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:25.213767    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:28.559875 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:28.559839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:29.023426 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:29.023390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:29.337173 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:29.337066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:29.448639 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:29.448603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:32.077245 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:32.077189    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:32.176346 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:32.176316    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:32.332622 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:32.332542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:32.772594 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:32.772552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:32.873805 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:32.873756    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:32.972550 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:32.972506    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:34.770366 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:34.770324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:36.604128 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:36.604080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:40.187887 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:40.187841    2582 patch_prober.go:28] interesting pod/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 02:21:40.188392 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:40.187916    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 02:21:41.242205 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:41.242174    2582 generic.go:356] "Generic (PLEG): container finished" podID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerID="321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c" exitCode=0
Jul 08 02:21:41.242624 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:41.242219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" event={"ID":"40fbb388-2dc9-44da-8eac-a5ad017858ad","Type":"ContainerDied","Data":"321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c"}
Jul 08 02:21:41.242624 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:41.242595    2582 scope.go:117] "RemoveContainer" containerID="321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c"
Jul 08 02:21:41.243669 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:41.243641    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:21:41.243751 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:41.243728    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:21:41.243796 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:41.243764    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:21:42.249178 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:42.249146    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" event={"ID":"40fbb388-2dc9-44da-8eac-a5ad017858ad","Type":"ContainerStarted","Data":"4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d"}
Jul 08 02:21:42.863093 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:42.863050    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:42.863316 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:42.863288    2582 patch_prober.go:28] interesting pod/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 08 02:21:42.863394 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:42.863351    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 08 02:21:43.862596 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:43.862556    2582 patch_prober.go:28] interesting pod/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 08 02:21:43.863077 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:43.862628    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 08 02:21:44.763078 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:44.763047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:44.862966 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:44.862928    2582 patch_prober.go:28] interesting pod/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 08 02:21:44.863404 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:44.862995    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 08 02:21:45.191933 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:45.191888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:45.291094 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:45.291049    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:45.392523 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:45.392476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:45.552852 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:45.552754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:45.863165 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:45.863064    2582 patch_prober.go:28] interesting pod/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 08 02:21:45.863165 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:45.863127    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 08 02:21:46.866618 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:46.866585    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:46.867062 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:46.866839    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:46.867584 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:46.867568    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:50.979048 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:50.979016    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:51.038016 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:51.037964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:51.227015 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:51.226982    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"]
Jul 08 02:21:51.227204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:51.227180    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy" containerID="cri-o://4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d" gracePeriod=30
Jul 08 02:21:51.250126 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:51.250048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:51.746167 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:51.746106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:52.100344 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:52.100253    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:52.201327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:52.201293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:52.301957 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:52.301918    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:52.432763 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:52.432662    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:56.490791 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.490725    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:56.543344 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543314    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-data\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.543344 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543350    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-credential-socket\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.543593 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543369    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-certs\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.543593 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543387    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-podinfo\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.543593 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543497    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d9vb\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-kube-api-access-7d9vb\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.543593 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543571    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-token\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.543829 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-socket\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.543829 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543652    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:56.543829 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40fbb388-2dc9-44da-8eac-a5ad017858ad-istiod-ca-cert\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.543829 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543723    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-envoy\") pod \"40fbb388-2dc9-44da-8eac-a5ad017858ad\" (UID: \"40fbb388-2dc9-44da-8eac-a5ad017858ad\") "
Jul 08 02:21:56.544030 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543869    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:56.544030 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.543928    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:56.544135 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.544115    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:56.544187 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.544136    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:56.544187 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.544150    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:56.544187 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.544172    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40fbb388-2dc9-44da-8eac-a5ad017858ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:21:56.544334 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.544298    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:56.545995 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.545969    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-kube-api-access-7d9vb" (OuterVolumeSpecName: "kube-api-access-7d9vb") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "kube-api-access-7d9vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:21:56.546294 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.546266    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:21:56.546414 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.546354    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:21:56.546414 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.546372    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "40fbb388-2dc9-44da-8eac-a5ad017858ad" (UID: "40fbb388-2dc9-44da-8eac-a5ad017858ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:21:56.644982 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.644946    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d9vb\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-kube-api-access-7d9vb\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:56.644982 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.644977    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:56.645185 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.644992    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40fbb388-2dc9-44da-8eac-a5ad017858ad-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:56.645185 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.645005    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:56.645185 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.645017    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:56.645185 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:56.645027    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40fbb388-2dc9-44da-8eac-a5ad017858ad-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:21:57.327344 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.327308    2582 generic.go:356] "Generic (PLEG): container finished" podID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerID="4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d" exitCode=0
Jul 08 02:21:57.327527 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.327358    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"
Jul 08 02:21:57.327527 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.327383    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" event={"ID":"40fbb388-2dc9-44da-8eac-a5ad017858ad","Type":"ContainerDied","Data":"4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d"}
Jul 08 02:21:57.327527 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.327440    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk" event={"ID":"40fbb388-2dc9-44da-8eac-a5ad017858ad","Type":"ContainerDied","Data":"fd09ef8ae8073050bdc3f913d2aa0ecf88e3f80954f7abd2b2e05c20ef6f728e"}
Jul 08 02:21:57.327527 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.327462    2582 scope.go:117] "RemoveContainer" containerID="4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d"
Jul 08 02:21:57.337395 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.337374    2582 scope.go:117] "RemoveContainer" containerID="321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c"
Jul 08 02:21:57.346035 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.345826    2582 scope.go:117] "RemoveContainer" containerID="4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d"
Jul 08 02:21:57.346109 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:21:57.346090    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d\": container with ID starting with 4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d not found: ID does not exist" containerID="4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d"
Jul 08 02:21:57.346149 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.346121    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d"} err="failed to get container status \"4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d\": rpc error: code = NotFound desc = could not find container \"4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d\": container with ID starting with 4f420c6fb04f51c6114a221a6f3f8c20a78e912768823a896e64985cb898e27d not found: ID does not exist"
Jul 08 02:21:57.346149 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.346138    2582 scope.go:117] "RemoveContainer" containerID="321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c"
Jul 08 02:21:57.346379 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:21:57.346363    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c\": container with ID starting with 321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c not found: ID does not exist" containerID="321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c"
Jul 08 02:21:57.346439 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.346381    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c"} err="failed to get container status \"321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c\": rpc error: code = NotFound desc = could not find container \"321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c\": container with ID starting with 321d5e8026d8e4566f1f982aea7e2843904c83cd6a6e5f9d79f6ae9d194df26c not found: ID does not exist"
Jul 08 02:21:57.350508 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.350484    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"]
Jul 08 02:21:57.354956 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:57.354933    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-645239-openshift-default-76648bf5bf-ql4mk"]
Jul 08 02:21:58.167665 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:58.167628    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" path="/var/lib/kubelet/pods/40fbb388-2dc9-44da-8eac-a5ad017858ad/volumes"
Jul 08 02:21:58.198495 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:58.198460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:58.298869 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:58.298838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:58.498483 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:58.498449    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:59.045514 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.045477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:59.321456 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.321366    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"]
Jul 08 02:21:59.322020 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.322000    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy"
Jul 08 02:21:59.322105 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.322024    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy"
Jul 08 02:21:59.322163 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.322112    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy"
Jul 08 02:21:59.325378 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.325353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.327968 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.327939    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4ea2af-openshift-default-dockercfg-gd5vf\""
Jul 08 02:21:59.339339 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.339311    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"]
Jul 08 02:21:59.350108 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.350077    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:59.369084 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whfrb\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-kube-api-access-whfrb\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.369287 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-credential-socket\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.369287 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-podinfo\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.369287 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-certs\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.369287 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istiod-ca-cert\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.369541 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369300    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-data\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.369541 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-socket\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.369541 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-token\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.369541 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.369402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-envoy\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.469986 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.469948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-data\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.469996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-socket\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-token\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-envoy\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whfrb\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-kube-api-access-whfrb\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470204 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-credential-socket\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470501 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-podinfo\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470501 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-certs\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470501 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istiod-ca-cert\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470501 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470393    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-data\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470501 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470438    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-socket\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470770 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470500    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:21:59.470770 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470681    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-credential-socket\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470770 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470731    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-certs\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.470994 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.470978    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istiod-ca-cert\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.472625 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.472602    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-envoy\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.472933 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.472915    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-podinfo\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.477881 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.477857    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-token\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.478167 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.478144    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whfrb\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-kube-api-access-whfrb\") pod \"e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") " pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.636819 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.636694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:21:59.794989 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.794960    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"]
Jul 08 02:21:59.797307 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:21:59.797276    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4cdb86_060a_4c65_8f81_6a2a683e0d3a.slice/crio-d8f520dd9d416b5bee2f9cedb51281c78e4a09f541fc986b1ef9425f60e6cca9 WatchSource:0}: Error finding container d8f520dd9d416b5bee2f9cedb51281c78e4a09f541fc986b1ef9425f60e6cca9: Status 404 returned error can't find the container with id d8f520dd9d416b5bee2f9cedb51281c78e4a09f541fc986b1ef9425f60e6cca9
Jul 08 02:21:59.799753 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.799692    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:21:59.799843 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.799789    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:21:59.799843 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:21:59.799826    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:22:00.346276 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:00.346238    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" event={"ID":"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a","Type":"ContainerStarted","Data":"bb611329f2ef42a3f93a3b59dc6c1412d1ce1e5ce5034fa61c1241047b9cc339"}
Jul 08 02:22:00.346758 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:00.346298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" event={"ID":"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a","Type":"ContainerStarted","Data":"d8f520dd9d416b5bee2f9cedb51281c78e4a09f541fc986b1ef9425f60e6cca9"}
Jul 08 02:22:00.370318 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:00.370262    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" podStartSLOduration=1.37024587 podStartE2EDuration="1.37024587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:21:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:22:00.368637353 +0000 UTC m=+2382.734471075" watchObservedRunningTime="2026-07-08 02:22:00.37024587 +0000 UTC m=+2382.736079593"
Jul 08 02:22:00.637387 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:00.637288    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:22:00.642393 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:00.642365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:22:01.351451 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:01.351415    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:22:01.352426 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:01.352408    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:22:02.260286 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:02.260251    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:02.433064 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:02.433026    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:02.536153 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:02.536067    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:03.047103 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:03.047066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:03.172840 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:03.172797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:03.274448 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:03.274416    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:06.753714 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:06.753674    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:07.097901 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:07.097809    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:07.408235 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:07.408137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:07.686358 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:07.686333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:10.270376 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:10.270338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:10.356193 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:10.356145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:10.428514 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:10.428477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:10.969955 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:10.969908    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:11.069041 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:11.068996    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:14.742079 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:14.741999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:16.352747 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:16.352692    2582 patch_prober.go:28] interesting pod/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 08 02:22:16.353254 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:16.352774    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 08 02:22:16.451354 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:16.451319    2582 generic.go:356] "Generic (PLEG): container finished" podID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerID="bb611329f2ef42a3f93a3b59dc6c1412d1ce1e5ce5034fa61c1241047b9cc339" exitCode=0
Jul 08 02:22:16.451541 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:16.451402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" event={"ID":"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a","Type":"ContainerDied","Data":"bb611329f2ef42a3f93a3b59dc6c1412d1ce1e5ce5034fa61c1241047b9cc339"}
Jul 08 02:22:16.451882 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:16.451859    2582 scope.go:117] "RemoveContainer" containerID="bb611329f2ef42a3f93a3b59dc6c1412d1ce1e5ce5034fa61c1241047b9cc339"
Jul 08 02:22:16.452866 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:16.452817    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:22:16.453003 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:16.452898    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:22:16.453003 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:16.452931    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 02:22:17.459058 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:17.459021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" event={"ID":"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a","Type":"ContainerStarted","Data":"173fb1346a246b4d3bfe067d9c71895584c9a770a9a30f457890fb4038ea4792"}
Jul 08 02:22:17.637799 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:17.637759    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:22:17.638048 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:17.638024    2582 patch_prober.go:28] interesting pod/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 08 02:22:17.638096 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:17.638075    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 08 02:22:18.199785 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:18.199750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:18.314447 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:18.314414    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:22:18.323198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:18.323169    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:22:18.637672 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:18.637569    2582 patch_prober.go:28] interesting pod/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 08 02:22:18.637672 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:18.637620    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 08 02:22:19.637521 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:19.637485    2582 patch_prober.go:28] interesting pod/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 08 02:22:19.637746 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:19.637541    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 08 02:22:20.637926 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:20.637884    2582 patch_prober.go:28] interesting pod/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 08 02:22:20.638352 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:20.637943    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 08 02:22:21.641701 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:21.641670    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:22:21.642135 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:21.641962    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:22:21.642651 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:21.642633    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:22:23.946338 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:23.946306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:24.043988 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:24.043958    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:31.922949 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:31.922913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:22:32.022563 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:22:32.022526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:23:24.070000 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:23:24.069969    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:19.827237 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:19.827199    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:20.207882 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:20.207853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:20.309011 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:20.308975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:20.454088 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:20.454044    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:25.918769 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:25.918727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:25.979354 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:25.979318    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:26.219151 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:26.218977    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"]
Jul 08 02:25:26.219490 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:26.219339    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy" containerID="cri-o://173fb1346a246b4d3bfe067d9c71895584c9a770a9a30f457890fb4038ea4792" gracePeriod=30
Jul 08 02:25:26.226731 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:26.226694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:26.645490 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:26.645409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:27.036961 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:27.036929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:27.135340 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:27.135309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:27.235290 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:27.235256    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:27.338024 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:27.337945    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:31.462846 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.462819    2582 generic.go:356] "Generic (PLEG): container finished" podID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerID="173fb1346a246b4d3bfe067d9c71895584c9a770a9a30f457890fb4038ea4792" exitCode=0
Jul 08 02:25:31.463198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.462891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" event={"ID":"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a","Type":"ContainerDied","Data":"173fb1346a246b4d3bfe067d9c71895584c9a770a9a30f457890fb4038ea4792"}
Jul 08 02:25:31.463198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.462958    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5" event={"ID":"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a","Type":"ContainerDied","Data":"d8f520dd9d416b5bee2f9cedb51281c78e4a09f541fc986b1ef9425f60e6cca9"}
Jul 08 02:25:31.463198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.462976    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8f520dd9d416b5bee2f9cedb51281c78e4a09f541fc986b1ef9425f60e6cca9"
Jul 08 02:25:31.463198 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.462990    2582 scope.go:117] "RemoveContainer" containerID="bb611329f2ef42a3f93a3b59dc6c1412d1ce1e5ce5034fa61c1241047b9cc339"
Jul 08 02:25:31.472567 ip-10-0-138-104 kubenswrapper[2582]: E0708 02:25:31.472546    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb611329f2ef42a3f93a3b59dc6c1412d1ce1e5ce5034fa61c1241047b9cc339\": container with ID starting with bb611329f2ef42a3f93a3b59dc6c1412d1ce1e5ce5034fa61c1241047b9cc339 not found: ID does not exist" containerID="bb611329f2ef42a3f93a3b59dc6c1412d1ce1e5ce5034fa61c1241047b9cc339"
Jul 08 02:25:31.475850 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.475832    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:25:31.531143 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531057    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whfrb\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-kube-api-access-whfrb\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531143 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531110    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-envoy\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531334 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531209    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-token\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531334 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-credential-socket\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531334 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-data\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531334 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531333    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-socket\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531491 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531377    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-podinfo\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531491 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531403    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-certs\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531491 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531429    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istiod-ca-cert\") pod \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\" (UID: \"cf4cdb86-060a-4c65-8f81-6a2a683e0d3a\") "
Jul 08 02:25:31.531788 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531656    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:25:31.532008 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.531766    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:25:31.532114 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.532043    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:25:31.532114 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.532072    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 02:25:31.532598 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.532561    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:25:31.533515 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.533483    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 02:25:31.533625 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.533556    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 02:25:31.533811 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.533786    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:25:31.533909 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.533806    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-kube-api-access-whfrb" (OuterVolumeSpecName: "kube-api-access-whfrb") pod "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" (UID: "cf4cdb86-060a-4c65-8f81-6a2a683e0d3a"). InnerVolumeSpecName "kube-api-access-whfrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 02:25:31.633031 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.632993    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-token\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:31.633031 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.633025    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-credential-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:31.633031 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.633038    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-data\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:31.633327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.633052    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-socket\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:31.633327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.633064    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-podinfo\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:31.633327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.633075    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-workload-certs\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:31.633327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.633086    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istiod-ca-cert\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:31.633327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.633096    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whfrb\" (UniqueName: \"kubernetes.io/projected/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-kube-api-access-whfrb\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:31.633327 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:31.633108    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a-istio-envoy\") on node \"ip-10-0-138-104.ec2.internal\" DevicePath \"\""
Jul 08 02:25:32.468953 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:32.468916    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"
Jul 08 02:25:32.486179 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:32.486148    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"]
Jul 08 02:25:32.491901 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:32.491877    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4ea2af-openshift-default-5754959f75-42fb5"]
Jul 08 02:25:32.947952 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:32.947917    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:33.048511 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:33.048465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:33.215130 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:33.215048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:34.166013 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:34.165979    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" path="/var/lib/kubelet/pods/cf4cdb86-060a-4c65-8f81-6a2a683e0d3a/volumes"
Jul 08 02:25:38.657993 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:38.657960    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zfr7f_0ba1d7f7-2361-430e-95c4-771bd00bf65d/manager/0.log"
Jul 08 02:25:38.783876 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:38.783841    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-764c6698d4-z2sld_204ae3bc-4129-479c-8ed1-6a63b3941b6b/manager/0.log"
Jul 08 02:25:38.915397 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:38.915315    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qxm46_87e19a72-9f74-49f6-a80e-05a3e59bcff5/server/0.log"
Jul 08 02:25:39.172907 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:39.172828    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8bbd955f5-8vk9k_1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0/copy-manifests/0.log"
Jul 08 02:25:39.186537 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:39.186498    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8bbd955f5-8vk9k_1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0/manager/0.log"
Jul 08 02:25:40.888085 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:40.888006    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nmfj2_20d9f101-e3ae-4f53-bb52-5b27ad436f40/manager/0.log"
Jul 08 02:25:40.999263 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:40.999233    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-km2rq_60da9b3c-eca9-4eff-848d-daf4f566df33/manager/0.log"
Jul 08 02:25:41.232001 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:41.231973    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2jfsl_f2725a78-7b45-4e07-928a-ef1171ab9363/registry-server/0.log"
Jul 08 02:25:41.586410 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:41.586330    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5zjnp_4ba4e908-55f5-4686-91ef-23ef4c019735/manager/0.log"
Jul 08 02:25:42.289602 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:42.289575    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bf889db5-ljbxk_01ff1b21-96dd-4822-8290-d52ca8622098/kube-auth-proxy/0.log"
Jul 08 02:25:42.403630 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:42.403604    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cjq7c_9f14c1af-ba7b-488f-b32f-7569d3ab8268/istio-proxy/1.log"
Jul 08 02:25:42.528906 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:42.528865    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g7kb2_943cf9b3-dd7b-411c-bbcb-d41a13093709/payload-pre-processing/0.log"
Jul 08 02:25:42.661889 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:42.661812    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zqmqr_2a488b61-01d3-411a-9a17-a55dd52eb600/payload-processing/0.log"
Jul 08 02:25:42.783609 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:42.783573    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d948f6b97-b56nd_f2138832-8c0b-47ac-a7ea-2ac8ee294447/router/0.log"
Jul 08 02:25:43.132470 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:43.132442    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nsg88_d7767164-f509-4e0d-ac48-7df79a5284ec/main/0.log"
Jul 08 02:25:43.473304 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:43.473267    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzdhrn_be0669c8-9268-4feb-adda-d462653347be/main/0.log"
Jul 08 02:25:43.591505 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:43.591475    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wldm7_f418f1a0-e270-491a-a750-677d98f59898/main/0.log"
Jul 08 02:25:43.960865 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:43.960834    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:44.021679 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:44.021645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:46.191559 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:46.191528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:48.259409 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:48.259372    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:48.321857 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:48.321826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:49.538535 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:49.538501    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:49.639613 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:49.639578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log" limit=1024
Jul 08 02:25:50.992430 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:50.992398    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cmvbh_7833b36c-c519-4737-8bf8-e63feee36e20/global-pull-secret-syncer/0.log"
Jul 08 02:25:51.126242 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:51.126209    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hbmmr_74144fe3-21d9-4741-b840-d6182f691d30/konnectivity-agent/0.log"
Jul 08 02:25:51.265132 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:51.265044    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-104.ec2.internal_4c6ce3691de19c622d88d1f963379cd4/haproxy/0.log"
Jul 08 02:25:56.943951 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:56.943913    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nmfj2_20d9f101-e3ae-4f53-bb52-5b27ad436f40/manager/0.log"
Jul 08 02:25:56.969190 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:56.969161    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-km2rq_60da9b3c-eca9-4eff-848d-daf4f566df33/manager/0.log"
Jul 08 02:25:57.036317 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:57.036281    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2jfsl_f2725a78-7b45-4e07-928a-ef1171ab9363/registry-server/0.log"
Jul 08 02:25:57.311180 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:57.311087    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5zjnp_4ba4e908-55f5-4686-91ef-23ef4c019735/manager/0.log"
Jul 08 02:25:59.108513 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:59.108472    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-c7skd_bb9ca78d-379e-41fb-baed-0446060babb9/cluster-monitoring-operator/0.log"
Jul 08 02:25:59.469539 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:59.469509    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptfh5_805c1ba3-13d7-4462-8638-77b691002ba7/node-exporter/0.log"
Jul 08 02:25:59.490318 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:59.490287    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptfh5_805c1ba3-13d7-4462-8638-77b691002ba7/kube-rbac-proxy/0.log"
Jul 08 02:25:59.516814 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:25:59.516784    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptfh5_805c1ba3-13d7-4462-8638-77b691002ba7/init-textfile/0.log"
Jul 08 02:26:01.344273 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.344240    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-75cq8_e15e1dd8-bc81-408a-80eb-465c0c466432/networking-console-plugin/0.log"
Jul 08 02:26:01.544012 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.543973    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"]
Jul 08 02:26:01.544399 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544387    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy"
Jul 08 02:26:01.544448 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544400    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy"
Jul 08 02:26:01.544448 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544409    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy"
Jul 08 02:26:01.544448 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544415    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy"
Jul 08 02:26:01.544448 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544427    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy"
Jul 08 02:26:01.544448 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544434    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy"
Jul 08 02:26:01.544601 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544507    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy"
Jul 08 02:26:01.544601 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544514    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4cdb86-060a-4c65-8f81-6a2a683e0d3a" containerName="istio-proxy"
Jul 08 02:26:01.544601 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.544521    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="40fbb388-2dc9-44da-8eac-a5ad017858ad" containerName="istio-proxy"
Jul 08 02:26:01.547880 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.547856    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.550664 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.550638    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qwgww\"/\"kube-root-ca.crt\""
Jul 08 02:26:01.551962 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.551943    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qwgww\"/\"openshift-service-ca.crt\""
Jul 08 02:26:01.552030 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.551946    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qwgww\"/\"default-dockercfg-pgwwr\""
Jul 08 02:26:01.558287 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.558261    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"]
Jul 08 02:26:01.623065 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.622972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-lib-modules\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.623065 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.623011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfbm4\" (UniqueName: \"kubernetes.io/projected/5c33640d-6961-4518-9dde-de382b18f6ed-kube-api-access-zfbm4\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.623274 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.623086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-sys\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.623274 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.623104    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-podres\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.623274 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.623171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-proc\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724463 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-sys\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724463 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-podres\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724679 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-proc\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724679 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-lib-modules\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724679 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfbm4\" (UniqueName: \"kubernetes.io/projected/5c33640d-6961-4518-9dde-de382b18f6ed-kube-api-access-zfbm4\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724679 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724560    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-sys\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724679 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724613    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-proc\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724892 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724683    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-podres\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.724892 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.724688    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c33640d-6961-4518-9dde-de382b18f6ed-lib-modules\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.733109 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.733080    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfbm4\" (UniqueName: \"kubernetes.io/projected/5c33640d-6961-4518-9dde-de382b18f6ed-kube-api-access-zfbm4\") pod \"perf-node-gather-daemonset-jbb82\" (UID: \"5c33640d-6961-4518-9dde-de382b18f6ed\") " pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.858975 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.858935    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:01.976558 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.976527    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/1.log"
Jul 08 02:26:01.983422 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:01.983384    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-kjx2n_8a09e13c-2839-42f4-9bda-5dbd0c89c9c9/console-operator/2.log"
Jul 08 02:26:02.004401 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:02.004374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"]
Jul 08 02:26:02.006691 ip-10-0-138-104 kubenswrapper[2582]: W0708 02:26:02.006665    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c33640d_6961_4518_9dde_de382b18f6ed.slice/crio-27d3e986ef5fb084cd3f1dfbc1acce4cc8443dc4e2e739ee730806985bbd23b3 WatchSource:0}: Error finding container 27d3e986ef5fb084cd3f1dfbc1acce4cc8443dc4e2e739ee730806985bbd23b3: Status 404 returned error can't find the container with id 27d3e986ef5fb084cd3f1dfbc1acce4cc8443dc4e2e739ee730806985bbd23b3
Jul 08 02:26:02.512149 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:02.512115    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-8r8ct_e9408cdf-e7b9-46b8-958d-8959a4c8c9db/download-server/0.log"
Jul 08 02:26:02.629649 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:02.629608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82" event={"ID":"5c33640d-6961-4518-9dde-de382b18f6ed","Type":"ContainerStarted","Data":"2cf7fb63b26f1dcb097fa8d35b28577ac83795e13025b1309abbbe00a0fb4d11"}
Jul 08 02:26:02.629865 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:02.629676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82" event={"ID":"5c33640d-6961-4518-9dde-de382b18f6ed","Type":"ContainerStarted","Data":"27d3e986ef5fb084cd3f1dfbc1acce4cc8443dc4e2e739ee730806985bbd23b3"}
Jul 08 02:26:02.629865 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:02.629698    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:02.647669 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:02.647609    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82" podStartSLOduration=1.64758962 podStartE2EDuration="1.64758962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:26:02.646906581 +0000 UTC m=+2625.012740303" watchObservedRunningTime="2026-07-08 02:26:02.64758962 +0000 UTC m=+2625.013423354"
Jul 08 02:26:03.083993 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:03.083962    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-nsn2w_7ca7ad82-aab4-48dd-b885-f3e673aec8f1/volume-data-source-validator/0.log"
Jul 08 02:26:04.135209 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:04.135176    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmnhz_5470ee1b-e719-4a61-b2aa-b5efb6f8942d/dns/0.log"
Jul 08 02:26:04.159017 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:04.158983    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmnhz_5470ee1b-e719-4a61-b2aa-b5efb6f8942d/kube-rbac-proxy/0.log"
Jul 08 02:26:04.257445 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:04.257413    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kls9s_9e50e08d-503e-4439-8c9d-37077570c073/dns-node-resolver/0.log"
Jul 08 02:26:04.823117 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:04.823027    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2t5qg_4a123056-ddd1-438a-99f5-015ea95bbdd4/node-ca/0.log"
Jul 08 02:26:05.947496 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:05.947467    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bf889db5-ljbxk_01ff1b21-96dd-4822-8290-d52ca8622098/kube-auth-proxy/0.log"
Jul 08 02:26:05.978293 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:05.978263    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cjq7c_9f14c1af-ba7b-488f-b32f-7569d3ab8268/istio-proxy/0.log"
Jul 08 02:26:06.006980 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:06.006946    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cjq7c_9f14c1af-ba7b-488f-b32f-7569d3ab8268/istio-proxy/1.log"
Jul 08 02:26:06.047240 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:06.047183    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g7kb2_943cf9b3-dd7b-411c-bbcb-d41a13093709/payload-pre-processing/0.log"
Jul 08 02:26:06.091767 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:06.091732    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zqmqr_2a488b61-01d3-411a-9a17-a55dd52eb600/payload-processing/0.log"
Jul 08 02:26:06.115575 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:06.115545    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d948f6b97-b56nd_f2138832-8c0b-47ac-a7ea-2ac8ee294447/router/0.log"
Jul 08 02:26:06.908178 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:06.908152    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x9wr5_cbd26fd0-e8ea-420f-9495-9a4de39d8213/serve-healthcheck-canary/0.log"
Jul 08 02:26:07.490276 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:07.490247    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-j2cdv_a01783bc-0824-4f3c-a7cf-ccc633c5a55b/insights-operator/0.log"
Jul 08 02:26:07.490989 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:07.490970    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-j2cdv_a01783bc-0824-4f3c-a7cf-ccc633c5a55b/insights-operator/1.log"
Jul 08 02:26:07.694600 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:07.694571    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kg58_438cf5d5-0436-422d-9424-e58bb52ac313/kube-rbac-proxy/0.log"
Jul 08 02:26:07.737197 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:07.737165    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kg58_438cf5d5-0436-422d-9424-e58bb52ac313/exporter/0.log"
Jul 08 02:26:07.776771 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:07.776677    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4kg58_438cf5d5-0436-422d-9424-e58bb52ac313/extractor/0.log"
Jul 08 02:26:08.645629 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:08.645603    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qwgww/perf-node-gather-daemonset-jbb82"
Jul 08 02:26:10.154832 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:10.154792    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zfr7f_0ba1d7f7-2361-430e-95c4-771bd00bf65d/manager/0.log"
Jul 08 02:26:10.246094 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:10.246056    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-764c6698d4-z2sld_204ae3bc-4129-479c-8ed1-6a63b3941b6b/manager/0.log"
Jul 08 02:26:10.268407 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:10.268379    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qxm46_87e19a72-9f74-49f6-a80e-05a3e59bcff5/server/0.log"
Jul 08 02:26:10.402787 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:10.402759    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8bbd955f5-8vk9k_1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0/manager/0.log"
Jul 08 02:26:10.420279 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:10.420254    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8bbd955f5-8vk9k_1b27e55a-5e4c-4c66-a3f7-96c84cdd44b0/copy-manifests/0.log"
Jul 08 02:26:11.714852 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:11.714823    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bf889db5-ljbxk_01ff1b21-96dd-4822-8290-d52ca8622098/kube-auth-proxy/0.log"
Jul 08 02:26:11.737777 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:11.737745    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cjq7c_9f14c1af-ba7b-488f-b32f-7569d3ab8268/istio-proxy/0.log"
Jul 08 02:26:11.765328 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:11.765298    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cjq7c_9f14c1af-ba7b-488f-b32f-7569d3ab8268/istio-proxy/1.log"
Jul 08 02:26:11.797653 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:11.797624    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g7kb2_943cf9b3-dd7b-411c-bbcb-d41a13093709/payload-pre-processing/0.log"
Jul 08 02:26:11.835545 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:11.835517    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zqmqr_2a488b61-01d3-411a-9a17-a55dd52eb600/payload-processing/0.log"
Jul 08 02:26:11.851562 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:11.851536    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d948f6b97-b56nd_f2138832-8c0b-47ac-a7ea-2ac8ee294447/router/0.log"
Jul 08 02:26:13.182355 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:13.182281    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bf889db5-ljbxk_01ff1b21-96dd-4822-8290-d52ca8622098/kube-auth-proxy/0.log"
Jul 08 02:26:13.202847 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:13.202817    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cjq7c_9f14c1af-ba7b-488f-b32f-7569d3ab8268/istio-proxy/0.log"
Jul 08 02:26:13.233333 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:13.233301    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-cjq7c_9f14c1af-ba7b-488f-b32f-7569d3ab8268/istio-proxy/1.log"
Jul 08 02:26:13.262342 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:13.262310    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-g7kb2_943cf9b3-dd7b-411c-bbcb-d41a13093709/payload-pre-processing/0.log"
Jul 08 02:26:13.301588 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:13.301561    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zqmqr_2a488b61-01d3-411a-9a17-a55dd52eb600/payload-processing/0.log"
Jul 08 02:26:13.316864 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:13.316837    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d948f6b97-b56nd_f2138832-8c0b-47ac-a7ea-2ac8ee294447/router/0.log"
Jul 08 02:26:16.820435 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:16.820408    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-ht6g7_e08708df-873e-4877-be3c-f3c86d50620c/migrator/0.log"
Jul 08 02:26:16.839527 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:16.839478    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-ht6g7_e08708df-873e-4877-be3c-f3c86d50620c/graceful-termination/0.log"
Jul 08 02:26:17.219140 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:17.219110    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-dq485_949f7197-dd85-4a7e-9e26-632696936f4c/kube-storage-version-migrator-operator/1.log"
Jul 08 02:26:17.219829 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:17.219808    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-dq485_949f7197-dd85-4a7e-9e26-632696936f4c/kube-storage-version-migrator-operator/0.log"
Jul 08 02:26:18.577379 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.577346    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5k5m_bb986e71-ea1a-4767-8509-e039afcb753c/kube-multus-additional-cni-plugins/0.log"
Jul 08 02:26:18.598173 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.598135    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5k5m_bb986e71-ea1a-4767-8509-e039afcb753c/egress-router-binary-copy/0.log"
Jul 08 02:26:18.618610 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.618583    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5k5m_bb986e71-ea1a-4767-8509-e039afcb753c/cni-plugins/0.log"
Jul 08 02:26:18.638207 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.638178    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5k5m_bb986e71-ea1a-4767-8509-e039afcb753c/bond-cni-plugin/0.log"
Jul 08 02:26:18.658042 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.658010    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5k5m_bb986e71-ea1a-4767-8509-e039afcb753c/routeoverride-cni/0.log"
Jul 08 02:26:18.677738 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.677696    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5k5m_bb986e71-ea1a-4767-8509-e039afcb753c/whereabouts-cni-bincopy/0.log"
Jul 08 02:26:18.698405 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.698373    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g5k5m_bb986e71-ea1a-4767-8509-e039afcb753c/whereabouts-cni/0.log"
Jul 08 02:26:18.761367 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.761339    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mnvt8_2f901c57-a93e-431b-872c-4485deec3967/kube-multus/0.log"
Jul 08 02:26:18.903472 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.903385    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pv6z5_51350b5f-d0b4-4b03-93ba-92bcbe31deeb/network-metrics-daemon/0.log"
Jul 08 02:26:18.922606 ip-10-0-138-104 kubenswrapper[2582]: I0708 02:26:18.922572    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pv6z5_51350b5f-d0b4-4b03-93ba-92bcbe31deeb/kube-rbac-proxy/0.log"