Jul 08 18:14:11.183178 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 18:14:11.183187 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 18:14:11.183194 ip-10-0-138-160 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 18:14:11.183423 ip-10-0-138-160 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 18:14:21.383413 ip-10-0-138-160 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 18:14:21.383434 ip-10-0-138-160 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9f6b3db6e1e048ffa4c3107a05965b0c --
Jul 08 18:15:59.644912 ip-10-0-138-160 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 18:16:00.091142 ip-10-0-138-160 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 18:16:00.091142 ip-10-0-138-160 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 18:16:00.091142 ip-10-0-138-160 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 18:16:00.091142 ip-10-0-138-160 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 18:16:00.091142 ip-10-0-138-160 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 18:16:00.092268 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.092190    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 18:16:00.098701 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098685    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:16:00.098701 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098700    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098705    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098709    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098713    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098718    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098722    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098724    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098729    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098733    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098736    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098739    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098742    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098745    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098748    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098750    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098754    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098756    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098759    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098762    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:16:00.098762 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098765    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098768    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098771    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098774    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098777    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098779    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098782    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098784    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098787    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098789    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098792    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098794    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098797    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098799    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098802    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098804    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098807    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098809    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098812    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098815    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:16:00.099208 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098817    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098820    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098822    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098825    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098828    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098830    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098833    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098835    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098839    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098843    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098846    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098848    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098851    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098854    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098857    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098860    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098862    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098865    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098868    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:16:00.099696 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098870    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098873    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098876    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098878    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098881    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098883    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098886    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098888    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098891    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098894    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098896    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098899    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098901    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098904    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098906    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098909    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098911    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098914    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098917    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098920    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:16:00.100155 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098922    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098925    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098928    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098931    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098934    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098937    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098940    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098943    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098946    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098948    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098951    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098954    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098957    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098960    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098962    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098965    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098967    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098970    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098972    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:16:00.100680 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.098975    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099672    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099680    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099684    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099687    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099690    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099693    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099696    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099699    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099703    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099707    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099710    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099712    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099715    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099718    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099720    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099723    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099726    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099729    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099732    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:16:00.101133 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099735    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099738    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099740    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099744    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099747    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099750    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099753    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099756    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099758    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099761    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099764    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099766    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099769    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099771    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099774    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099776    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099790    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099793    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099796    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:16:00.101623 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099798    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099801    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099804    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099806    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099809    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099813    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099817    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099821    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099824    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099827    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099829    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099832    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099835    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099838    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099841    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099844    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099846    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099849    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099852    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:16:00.102090 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099855    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099857    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099860    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099862    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099865    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099868    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099870    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099873    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099876    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099879    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099881    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099884    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099886    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099889    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099892    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099895    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099899    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099902    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099905    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:16:00.102554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099908    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099911    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099914    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099916    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099919    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099922    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099925    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099928    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099930    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099933    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099936    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099938    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099941    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099943    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099945    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099948    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099951    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099953    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099955    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099958    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:16:00.103020 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099960    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099963    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.099965    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100315    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100321    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100324    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100327    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100330    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100333    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100336    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100339    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100341    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100344    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100347    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100349    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100352    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100355    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100357    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100361    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100364    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:16:00.103513 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100367    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100369    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100372    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100375    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100377    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100380    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100382    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100385    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100387    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100390    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100392    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100396    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100398    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100401    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100403    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100406    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100408    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100411    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100413    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100416    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:16:00.104016 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100431    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100435    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100438    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100441    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100444    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100446    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100451    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100455    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100459    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100461    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100464    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100467    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100470    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100473    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100476    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100480    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100483    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100486    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100489    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:16:00.104553 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100493    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100497    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100500    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100503    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100506    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100508    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100511    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100514    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100517    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100519    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100522    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100525    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100527    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100529    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100532    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100535    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100537    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100540    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100542    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100545    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:16:00.105025 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100549    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100552    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100554    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100557    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100560    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100562    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100565    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100567    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100570    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100572    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100575    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100577    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100580    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100583    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100586    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100588    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100591    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100594    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100597    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100599    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:16:00.105543 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100601    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100604    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.100607    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100685    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100691    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100698    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100703    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100707    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100711    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100726    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100731    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100736    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100743    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100747    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100750    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100753    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100756    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100759    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100763    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100766    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100769    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100772    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100775    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100778    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 18:16:00.106081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100781    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100785    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100788    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100791    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100794    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100798    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100801    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100803    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100806    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100809    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100812    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100816    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100820    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100822    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100825    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100828    2558 flags.go:64] FLAG: --enable-server="true"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100831    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100836    2558 flags.go:64] FLAG: --event-burst="100"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100839    2558 flags.go:64] FLAG: --event-qps="50"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100843    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100848    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100851    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100855    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100858    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100861    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 18:16:00.106660 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100864    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100867    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100870    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100873    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100876    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100879    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100882    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100885    2558 flags.go:64] FLAG: --feature-gates=""
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100888    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100892    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100895    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100897    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100901    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100903    2558 flags.go:64] FLAG: --help="false"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100906    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100909    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100912    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100915    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100918    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100921    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100924    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100927    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100930    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 18:16:00.107265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100933    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100936    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100939    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100946    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100950    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100953    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100956    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100959    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100961    2558 flags.go:64] FLAG: --lock-file=""
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100964    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100967    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100970    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100976    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100979    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100982    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100985    2558 flags.go:64] FLAG: --logging-format="text"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100988    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100991    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100994    2558 flags.go:64] FLAG: --manifest-url=""
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.100997    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101001    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101004    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101008    2558 flags.go:64] FLAG: --max-pods="110"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101011    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101013    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 18:16:00.107871 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101016    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101019    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101022    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101025    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101028    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101035    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101038    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101040    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101044    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101046    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101053    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101055    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101059    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101062    2558 flags.go:64] FLAG: --port="10250"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101066    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101068    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d1d778fb24c176e1"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101071    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101074    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101077    2558 flags.go:64] FLAG: --register-node="true"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101080    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101084    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101087    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101090    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101093    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101096    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 18:16:00.108514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101099    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101102    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101105    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101108    2558 flags.go:64] FLAG: --runonce="false"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101111    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101114    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101117    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101120    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101122    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101125    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101128    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101131    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101134    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101138    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101141    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101143    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101147    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101151    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101154    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101159    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101162    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101165    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101169    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101172    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101174    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 18:16:00.109434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101177    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101180    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101183    2558 flags.go:64] FLAG: --v="2"
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101188    2558 flags.go:64] FLAG: --version="false"
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101191    2558 flags.go:64] FLAG: --vmodule=""
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101195    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.101198    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101322    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101326    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101329    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101332    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101334    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101337    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101339    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101342    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101345    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101348    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101350    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101353    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101357    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101360    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:16:00.110322 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101363    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101366    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101369    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101373    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101375    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101378    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101381    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101383    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101386    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101388    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101391    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101394    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101396    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101399    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101401    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101405    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101407    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101410    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101412    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101415    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:16:00.110858 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101417    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101420    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101422    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101425    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101427    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101430    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101432    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101435    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101438    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101440    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101443    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101445    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101448    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101450    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101453    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101457    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101460    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101463    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101465    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101468    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:16:00.111350 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101470    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101473    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101477    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101480    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101483    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101486    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101489    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101492    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101498    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101501    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101503    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101506    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101509    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101511    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101513    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101516    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101518    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101521    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101523    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101526    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:16:00.111842 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101528    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101530    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101533    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101537    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101540    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101543    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101546    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101550    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101552    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101555    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101557    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101560    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101563    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101565    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101567    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101570    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101572    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101575    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101577    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:16:00.112314 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101580    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101583    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101586    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101588    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101591    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.101593    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.102381    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.110687    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.110700    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.110720    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.110730    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110784    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110789    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110793    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:16:00.112784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110796    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110799    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110802    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110805    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110809    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110811    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110814    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110817    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110820    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110823    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110825    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110828    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110831    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110834    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110836    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110840    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110842    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110846    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110850    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:16:00.113128 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110852    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110855    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110857    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110860    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110863    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110866    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110869    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110871    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110874    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110877    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110879    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110882    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110884    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110887    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110889    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110892    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110894    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110897    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110900    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110902    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:16:00.113593 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110905    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110908    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110911    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110913    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110916    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110919    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110922    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110925    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110928    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110931    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110933    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110936    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110939    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110941    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110945    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110949    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110952    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110955    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110957    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:16:00.114081 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110960    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110963    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110965    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110968    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110970    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110973    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110975    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110978    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110980    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110983    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110985    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110990    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110993    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110997    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.110999    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111002    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111005    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111007    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111010    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:16:00.114524 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111013    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111015    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111018    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111021    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111023    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111026    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111028    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111031    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111033    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111036    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111039    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111041    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111043    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111046    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111049    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111051    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111054    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111056    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:16:00.115032 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111059    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.111064    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111174    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111179    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111183    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111186    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111189    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111192    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111195    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111197    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111200    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111203    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111206    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111208    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111211    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 18:16:00.115479 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111214    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111216    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111219    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111222    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111224    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111227    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111229    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111232    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111234    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111237    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111239    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111242    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111244    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111247    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111250    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111252    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111255    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111257    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111260    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 18:16:00.115872 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111262    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111266    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111270    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111273    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111276    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111279    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111281    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111284    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111286    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111289    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111292    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111295    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111297    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111301    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111303    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111306    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111309    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111311    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111314    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 18:16:00.116329 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111316    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111328    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111332    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111334    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111337    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111339    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111342    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111344    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111347    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111350    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111352    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111355    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111359    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111363    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111367    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111370    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111373    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111376    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111378    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 18:16:00.116859 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111381    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111383    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111386    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111388    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111391    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111393    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111396    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111399    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111402    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111404    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111407    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111409    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111412    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111414    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111417    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111419    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111422    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111424    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111427    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111429    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 18:16:00.117318 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111432    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111434    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111437    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111439    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111442    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111444    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111447    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111449    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:00.111452    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.111457    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.111559    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.113914    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.115536    2558 server.go:1019] "Starting client certificate rotation"
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.115649    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 18:16:00.117802 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.115687    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 18:16:00.118305 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.118292    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 18:16:00.121486 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.121466    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 18:16:00.133238 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.133221    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 08 18:16:00.135608 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.135592    2558 log.go:25] "Validated CRI v1 image API"
Jul 08 18:16:00.136351 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.136338    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 18:16:00.139904 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.139881    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bf638f34-a32c-40bb-814d-9f616512c93b:/dev/nvme0n1p4 c9168ba0-f04d-4bbc-b238-4a1d7e620033:/dev/nvme0n1p3]
Jul 08 18:16:00.139972 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.139902    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 18:16:00.145686 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.145549    2558 manager.go:216] Machine: {Timestamp:2026-07-08 18:16:00.144148997 +0000 UTC m=+0.373321904 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096471 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23793dc0e1887282cff657a4a23c8e SystemUUID:ec23793d-c0e1-8872-82cf-f657a4a23c8e BootID:9f6b3db6-e1e0-48ff-a4c3-107a05965b0c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:09:5b:38:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:09:5b:38:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:46:d2:d8:b8:b7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 18:16:00.145686 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.145678    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 18:16:00.145816 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.145751    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 18:16:00.146306 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.146289    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 18:16:00.149349 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.149325    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 18:16:00.149477 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.149351    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 18:16:00.150888 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.150878    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 18:16:00.150921 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.150890    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 18:16:00.150921 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.150898    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 18:16:00.151729 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.151719    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 18:16:00.153628 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.153616    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 18:16:00.158267 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.158256    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 18:16:00.158372 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.158362    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 18:16:00.158415 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.158390    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 18:16:00.158415 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.158399    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 18:16:00.158415 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.158413    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 18:16:00.158522 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.158422    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 08 18:16:00.158522 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.158430    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 18:16:00.159414 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.159395    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 18:16:00.159414 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.159418    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 18:16:00.165218 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.165200    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 18:16:00.167462 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.167448    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 18:16:00.167528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.167478    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 18:16:00.168888 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168874    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 18:16:00.168888 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168891    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168896    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168902    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168915    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168920    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168928    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168933    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168939    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168945    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168953    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 18:16:00.168993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.168959    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 18:16:00.170716 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.170704    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 18:16:00.170716 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.170716    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 18:16:00.170860 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.170836    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 18:16:00.170860 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.170836    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 18:16:00.173762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.173749    2558 server.go:1268] "Started kubelet"
Jul 08 18:16:00.173870 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.173817    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 18:16:00.174030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.173831    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 18:16:00.174112 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.174038    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 18:16:00.174546 ip-10-0-138-160 systemd[1]: Started Kubernetes Kubelet.
Jul 08 18:16:00.175809 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.175794    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 18:16:00.176782 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.176760    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 18:16:00.180364 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.180336    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 18:16:00.183833 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.183810    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 18:16:00.184796 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.184777    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 18:16:00.184796 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.184788    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 18:16:00.185003 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.184985    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:00.185096 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.183817    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-160.ec2.internal.18c0633b9fc9905e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-160.ec2.internal,UID:ip-10-0-138-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-160.ec2.internal,},FirstTimestamp:2026-07-08 18:16:00.173723742 +0000 UTC m=+0.402896650,LastTimestamp:2026-07-08 18:16:00.173723742 +0000 UTC m=+0.402896650,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-160.ec2.internal,}"
Jul 08 18:16:00.185678 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.185663    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 18:16:00.185791 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.185780    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 18:16:00.185864 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.185750    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 18:16:00.185970 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.185958    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 18:16:00.185970 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.185970    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 18:16:00.186211 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.186164    2558 factory.go:55] Registering systemd factory
Jul 08 18:16:00.186211 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.186185    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 08 18:16:00.186414 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.186398    2558 factory.go:153] Registering CRI-O factory
Jul 08 18:16:00.186465 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.186419    2558 factory.go:223] Registration of the crio container factory successfully
Jul 08 18:16:00.186494 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.186484    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 18:16:00.186528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.186507    2558 factory.go:103] Registering Raw factory
Jul 08 18:16:00.186528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.186527    2558 manager.go:1196] Started watching for new ooms in manager
Jul 08 18:16:00.187218 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.187191    2558 manager.go:349] Starting recovery of all containers
Jul 08 18:16:00.187874 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.187851    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 18:16:00.187991 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.187969    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 18:16:00.195868 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.195842    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4rt9z"
Jul 08 18:16:00.199022 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.199007    2558 manager.go:354] Recovery completed
Jul 08 18:16:00.201494 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.201384    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4rt9z"
Jul 08 18:16:00.202987 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.202974    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:16:00.204994 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.204978    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:16:00.205055 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.205009    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:16:00.205055 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.205023    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:16:00.205590 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.205574    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 18:16:00.205680 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.205590    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 18:16:00.205680 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.205599    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:16:00.205680 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.205610    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 18:16:00.206295 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.206280    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:16:00.206361 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.206310    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:16:00.206361 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.206325    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:16:00.206866 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.206805    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-160.ec2.internal.18c0633ba1a6b2fe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-160.ec2.internal,UID:ip-10-0-138-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-160.ec2.internal,},FirstTimestamp:2026-07-08 18:16:00.204993278 +0000 UTC m=+0.434166188,LastTimestamp:2026-07-08 18:16:00.204993278 +0000 UTC m=+0.434166188,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-160.ec2.internal,}"
Jul 08 18:16:00.207720 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.207706    2558 policy_none.go:49] "None policy: Start"
Jul 08 18:16:00.207765 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.207726    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 18:16:00.207765 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.207736    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 18:16:00.209727 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.209715    2558 policy_none.go:47] "Start"
Jul 08 18:16:00.244222 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.244205    2558 manager.go:337] "Starting Device Plugin manager"
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.244236    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.244248    2558 server.go:87] "Starting device plugin registration server"
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.244500    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.244514    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.244718    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.244796    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.244818    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.245255    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 18:16:00.261092 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.245297    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:00.280560 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.280532    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 18:16:00.281662 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.281648    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 18:16:00.281766 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.281690    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 18:16:00.281766 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.281713    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 18:16:00.281766 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.281748    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 18:16:00.284009 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.283991    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:16:00.344808 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.344753    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:16:00.345530 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.345516    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:16:00.345601 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.345542    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:16:00.345601 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.345553    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:16:00.345601 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.345584    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.356914 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.356900    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.356980 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.356920    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-160.ec2.internal\": node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:00.372458 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.372436    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:00.382510 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.382493    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal"]
Jul 08 18:16:00.382563 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.382544    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:16:00.384342 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.384327    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:16:00.384404 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.384356    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:16:00.384404 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.384366    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:16:00.386687 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.386676    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:16:00.386740 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.386692    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d9a6fed735c32fc3e333fe15459579-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"d6d9a6fed735c32fc3e333fe15459579\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.386740 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.386711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d9a6fed735c32fc3e333fe15459579-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"d6d9a6fed735c32fc3e333fe15459579\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.386835 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.386815    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.386882 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.386852    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:16:00.387366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.387351    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:16:00.387429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.387374    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:16:00.387429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.387386    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:16:00.387429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.387351    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:16:00.387559 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.387418    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:16:00.387559 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.387445    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:16:00.389700 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.389686    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.389778 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.389709    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 18:16:00.390379 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.390364    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 18:16:00.390449 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.390396    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 18:16:00.390449 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.390410    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeHasSufficientPID"
Jul 08 18:16:00.404176 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.404154    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-160.ec2.internal\" not found" node="ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.408496 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.408481    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-160.ec2.internal\" not found" node="ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.473130 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:00.473111    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:00.487475 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.487447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d9a6fed735c32fc3e333fe15459579-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"d6d9a6fed735c32fc3e333fe15459579\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.487557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.487481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d9a6fed735c32fc3e333fe15459579-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"d6d9a6fed735c32fc3e333fe15459579\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.487557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.487503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbb64130c7b615dfb98b4e6af62c0947-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"bbb64130c7b615dfb98b4e6af62c0947\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.487557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.487544    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d9a6fed735c32fc3e333fe15459579-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"d6d9a6fed735c32fc3e333fe15459579\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:00.487557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:00.487549    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d9a6fed735c32fc3e333fe15459579-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal\" (UID: \"d6d9a6fed735c32fc3e333fe15459579\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:01.767127 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:01.767107    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:01.781436 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:01.781421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbb64130c7b615dfb98b4e6af62c0947-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"bbb64130c7b615dfb98b4e6af62c0947\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:01.781488 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:01.781448    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbb64130c7b615dfb98b4e6af62c0947-config\") pod \"kube-apiserver-proxy-ip-10-0-138-160.ec2.internal\" (UID: \"bbb64130c7b615dfb98b4e6af62c0947\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:01.867867 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:01.867806    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:01.900334 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:01.900310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:01.905446 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:01.905232    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:01.967879 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:01.967854    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:02.068416 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:02.068392    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:02.168890 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:02.168868    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:02.200500 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.200467    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:16:02.269032 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:02.268999    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:02.307985 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.307953    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 18:16:02.308444 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.308095    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 18:16:02.308444 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.308134    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 18:16:02.369518 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:02.369502    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:02.382833 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.382809    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:16:02.398072 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.398046    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:11:01 +0000 UTC" deadline="2028-03-16 10:27:59.92697156 +0000 UTC"
Jul 08 18:16:02.398072 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.398067    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14800h11m57.528906867s"
Jul 08 18:16:02.470381 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:02.470324    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:02.570792 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:02.570772    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:02.671342 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:02.671303    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-160.ec2.internal\" not found"
Jul 08 18:16:02.699111 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.699088    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:16:02.778941 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.778890    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:02.788144 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.788126    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 18:16:02.788989 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.788973    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal"
Jul 08 18:16:02.799612 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:02.799595    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 18:16:03.352817 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.352784    2558 apiserver.go:52] "Watching apiserver"
Jul 08 18:16:03.360760 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.360742    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 18:16:03.361110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.361087    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-lrvbj","openshift-dns/node-resolver-hp7x6","openshift-multus/multus-additional-cni-plugins-ss2jv","openshift-multus/network-metrics-daemon-l27kq","openshift-image-registry/node-ca-pg98t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal","openshift-multus/multus-q7nz9","openshift-network-diagnostics/network-check-target-qq524","openshift-network-operator/iptables-alerter-np8l6","openshift-ovn-kubernetes/ovnkube-node-zd56w","kube-system/global-pull-secret-syncer-c2ct2","kube-system/konnectivity-agent-2qk6t","kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"]
Jul 08 18:16:03.363776 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.363755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.365979 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.365957    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.366070 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.366049    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:03.366112 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.365962    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 18:16:03.366112 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.366063    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 18:16:03.366112 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.366103    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 18:16:03.366228 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.366164    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4slbl\""
Jul 08 18:16:03.366378 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.366366    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 18:16:03.368114 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.368098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.369935 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.369920    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 18:16:03.370271 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.370259    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 18:16:03.370322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.370273    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hbx49\""
Jul 08 18:16:03.370402 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.370388    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:03.370479 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.370461    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:03.372669 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.372656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.374817 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.374803    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.374957 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.374937    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 18:16:03.375021 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.374942    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m22tp\""
Jul 08 18:16:03.375021 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.374944    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 18:16:03.375021 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.375001    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 18:16:03.377103 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.377089    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.377233 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.377218    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 18:16:03.377299 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.377258    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 18:16:03.377396 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.377378    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 18:16:03.377899 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.377886    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7mvwc\""
Jul 08 18:16:03.379305 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.379286    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 18:16:03.379410 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.379394    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 18:16:03.379570 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.379550    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:03.379668 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.379610    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:03.380334 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.380313    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 18:16:03.380334 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.380330    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qf2rs\""
Jul 08 18:16:03.380476 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.380453    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 18:16:03.383586 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.383568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.385647 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.385630    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 18:16:03.385696 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.385654    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 18:16:03.385754 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.385705    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-42bvq\""
Jul 08 18:16:03.385934 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.385915    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.387927 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.387913    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 18:16:03.388333 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388317    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.388606 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-k8s-cni-cncf-io\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.388645 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-daemon-config\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.388645 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8k4j\" (UniqueName: \"kubernetes.io/projected/5be65041-d2a5-4190-ac42-afc16106a8b4-kube-api-access-d8k4j\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.388721 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388652    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:03.388721 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpwbx\" (UniqueName: \"kubernetes.io/projected/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-kube-api-access-wpwbx\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.388721 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-cni-bin\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.388721 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlzc\" (UniqueName: \"kubernetes.io/projected/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-kube-api-access-9xlzc\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.388872 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388735    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-cni-binary-copy\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.388872 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388757    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-registration-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.388872 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-device-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.388872 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac55bc61-004b-4008-91b5-011e34bb8b29-dbus\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.388872 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388807    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-system-cni-dir\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.388872 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388844    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-system-cni-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-socket-dir-parent\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-etc-kubernetes\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.388987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-socket-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-cni-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-os-release\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-multus-certs\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389060    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.389083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-sys-fs\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389092    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5be65041-d2a5-4190-ac42-afc16106a8b4-host\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389106    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-iptables-alerter-script\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-netns\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-etc-selinux\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-hosts-file\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389216    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-cnibin\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-cnibin\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389254    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389258    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-host-slash\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhr6l\" (UniqueName: \"kubernetes.io/projected/65ad62ef-ab57-4306-8850-3a6030c73c66-kube-api-access-rhr6l\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-cni-binary-copy\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-cni-multus\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-hostroot\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-conf-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389356    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr4nc\" (UniqueName: \"kubernetes.io/projected/8ac370ef-cd00-4259-8fbd-90e01d361a04-kube-api-access-dr4nc\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.389523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac55bc61-004b-4008-91b5-011e34bb8b29-kubelet-config\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389412    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-os-release\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389448    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f67tk\" (UniqueName: \"kubernetes.io/projected/78a391cf-12fc-425e-800b-2269af2d1882-kube-api-access-f67tk\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5be65041-d2a5-4190-ac42-afc16106a8b4-serviceca\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frh7\" (UniqueName: \"kubernetes.io/projected/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-kube-api-access-7frh7\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-tmp-dir\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-kubelet\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389746    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389755    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p2zt4\""
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389746    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 18:16:03.390110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.389772    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 18:16:03.390484 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.390341    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 18:16:03.390562 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.390549    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2np8g\""
Jul 08 18:16:03.390595 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.390560    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 18:16:03.390625 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.390615    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:03.391954 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.391940    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 18:16:03.392673 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.392660    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 18:16:03.392804 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.392788    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vrxsc\""
Jul 08 18:16:03.392865 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.392814    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 18:16:03.396430 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.396418    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:16:03.411585 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.411569    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mklgr"
Jul 08 18:16:03.420241 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.420224    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mklgr"
Jul 08 18:16:03.480474 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.480457    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 18:16:03.489766 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-netns\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.489830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-hosts-file\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.489830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-kubernetes\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.489830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-host\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.489978 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489860    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-hosts-file\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.489978 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489889    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-netns\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.489978 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-kubelet\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.489978 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-log-socket\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.489978 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.489972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98bd3e18-c809-4fce-bdaf-217db4b24b83-agent-certs\") pod \"konnectivity-agent-2qk6t\" (UID: \"98bd3e18-c809-4fce-bdaf-217db4b24b83\") " pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-cnibin\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-cnibin\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-cni-bin\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490065    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-cnibin\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-cni-binary-copy\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490096    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-cnibin\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-cni-multus\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490184    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-hostroot\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490193    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-cni-multus\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-conf-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac55bc61-004b-4008-91b5-011e34bb8b29-kubelet-config\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-tmp-dir\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490273    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-conf-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490306    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ac55bc61-004b-4008-91b5-011e34bb8b29-kubelet-config\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f67tk\" (UniqueName: \"kubernetes.io/projected/78a391cf-12fc-425e-800b-2269af2d1882-kube-api-access-f67tk\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9g75\" (UniqueName: \"kubernetes.io/projected/eb99121e-615f-4ec2-a653-21458780a950-kube-api-access-r9g75\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-slash\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq45l\" (UniqueName: \"kubernetes.io/projected/61dd6167-f489-4f80-9539-949a3a7f32e3-kube-api-access-bq45l\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490346    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-hostroot\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.490405    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490407    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-k8s-cni-cncf-io\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpwbx\" (UniqueName: \"kubernetes.io/projected/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-kube-api-access-wpwbx\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490450    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-k8s-cni-cncf-io\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.490480    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:03.990460079 +0000 UTC m=+3.026116721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490495    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysctl-d\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.490762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-cni-netd\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490571    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-tmp-dir\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-cni-binary-copy\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-registration-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac55bc61-004b-4008-91b5-011e34bb8b29-dbus\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-systemd-units\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490678    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-registration-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490708    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-systemd\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490712    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-cni-binary-copy\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-system-cni-dir\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490786    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ac55bc61-004b-4008-91b5-011e34bb8b29-dbus\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490791    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-system-cni-dir\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-socket-dir-parent\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490840    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-socket-dir-parent\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-socket-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.491429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490874    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-os-release\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490942    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-socket-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-sys-fs\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5be65041-d2a5-4190-ac42-afc16106a8b4-host\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.490986    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-os-release\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491016    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5be65041-d2a5-4190-ac42-afc16106a8b4-host\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491021    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-sys-fs\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysconfig\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491067    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-cni-binary-copy\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-etc-selinux\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb99121e-615f-4ec2-a653-21458780a950-tmp\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-var-lib-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491160    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-etc-selinux\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.492060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98bd3e18-c809-4fce-bdaf-217db4b24b83-konnectivity-ca\") pod \"konnectivity-agent-2qk6t\" (UID: \"98bd3e18-c809-4fce-bdaf-217db4b24b83\") " pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-host-slash\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb99121e-615f-4ec2-a653-21458780a950-etc-tuned\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491241    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-host-slash\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhr6l\" (UniqueName: \"kubernetes.io/projected/65ad62ef-ab57-4306-8850-3a6030c73c66-kube-api-access-rhr6l\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr4nc\" (UniqueName: \"kubernetes.io/projected/8ac370ef-cd00-4259-8fbd-90e01d361a04-kube-api-access-dr4nc\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491302    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491327    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frh7\" (UniqueName: \"kubernetes.io/projected/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-kube-api-access-7frh7\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-os-release\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491374    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491382    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5be65041-d2a5-4190-ac42-afc16106a8b4-serviceca\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.491439    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-modprobe-d\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-lib-modules\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.492581 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.491477    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret podName:ac55bc61-004b-4008-91b5-011e34bb8b29 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:03.991462077 +0000 UTC m=+3.027118709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret") pod "global-pull-secret-syncer-c2ct2" (UID: "ac55bc61-004b-4008-91b5-011e34bb8b29") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491498    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65ad62ef-ab57-4306-8850-3a6030c73c66-os-release\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491506    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-node-log\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-ovnkube-config\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-kubelet\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-daemon-config\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8k4j\" (UniqueName: \"kubernetes.io/projected/5be65041-d2a5-4190-ac42-afc16106a8b4-kube-api-access-d8k4j\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491607    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-run\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491667    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-kubelet\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491740    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-run-netns\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491773    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-ovnkube-script-lib\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491797    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5be65041-d2a5-4190-ac42-afc16106a8b4-serviceca\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-cni-bin\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491840    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-var-lib-cni-bin\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlzc\" (UniqueName: \"kubernetes.io/projected/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-kube-api-access-9xlzc\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491871    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-device-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.493030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysctl-conf\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-systemd\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-ovn\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-env-overrides\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491960    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/78a391cf-12fc-425e-800b-2269af2d1882-device-dir\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61dd6167-f489-4f80-9539-949a3a7f32e3-ovn-node-metrics-cert\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.491994    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-daemon-config\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492043    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-system-cni-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-etc-kubernetes\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-sys\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-var-lib-kubelet\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492112    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-system-cni-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-etc-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492127    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-etc-kubernetes\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-cni-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-multus-certs\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.493536 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-iptables-alerter-script\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.494002 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492240    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-multus-cni-dir\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.494002 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492251    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-host-run-multus-certs\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.494002 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492355    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65ad62ef-ab57-4306-8850-3a6030c73c66-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.494002 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.492635    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-iptables-alerter-script\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.499584 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.499565    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 18:16:03.502480 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.502460    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:16:03.502571 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.502487    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:16:03.502571 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.502499    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ftwk7 for pod openshift-network-diagnostics/network-check-target-qq524: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:03.502676 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.502595    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7 podName:d1238578-f235-44bc-a0a6-16afae54021b nodeName:}" failed. No retries permitted until 2026-07-08 18:16:04.002578774 +0000 UTC m=+3.038235397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ftwk7" (UniqueName: "kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7") pod "network-check-target-qq524" (UID: "d1238578-f235-44bc-a0a6-16afae54021b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:03.502929 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.502910    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlzc\" (UniqueName: \"kubernetes.io/projected/90437aed-158a-4fe6-b1b3-6a4fd38d9c84-kube-api-access-9xlzc\") pod \"multus-q7nz9\" (UID: \"90437aed-158a-4fe6-b1b3-6a4fd38d9c84\") " pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.503010 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.502937    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpwbx\" (UniqueName: \"kubernetes.io/projected/ad07d4bb-fdd7-4a94-8d8d-155416ad676c-kube-api-access-wpwbx\") pod \"node-resolver-hp7x6\" (UID: \"ad07d4bb-fdd7-4a94-8d8d-155416ad676c\") " pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.503010 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.502940    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f67tk\" (UniqueName: \"kubernetes.io/projected/78a391cf-12fc-425e-800b-2269af2d1882-kube-api-access-f67tk\") pod \"aws-ebs-csi-driver-node-vxpjb\" (UID: \"78a391cf-12fc-425e-800b-2269af2d1882\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.503010 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.502940    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8k4j\" (UniqueName: \"kubernetes.io/projected/5be65041-d2a5-4190-ac42-afc16106a8b4-kube-api-access-d8k4j\") pod \"node-ca-pg98t\" (UID: \"5be65041-d2a5-4190-ac42-afc16106a8b4\") " pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.503193 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.503052    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frh7\" (UniqueName: \"kubernetes.io/projected/ece2b5df-6861-4a59-90cb-31dc56bc5c4a-kube-api-access-7frh7\") pod \"iptables-alerter-np8l6\" (UID: \"ece2b5df-6861-4a59-90cb-31dc56bc5c4a\") " pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.503193 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.503178    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhr6l\" (UniqueName: \"kubernetes.io/projected/65ad62ef-ab57-4306-8850-3a6030c73c66-kube-api-access-rhr6l\") pod \"multus-additional-cni-plugins-ss2jv\" (UID: \"65ad62ef-ab57-4306-8850-3a6030c73c66\") " pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.503405 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.503390    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr4nc\" (UniqueName: \"kubernetes.io/projected/8ac370ef-cd00-4259-8fbd-90e01d361a04-kube-api-access-dr4nc\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:03.592805 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9g75\" (UniqueName: \"kubernetes.io/projected/eb99121e-615f-4ec2-a653-21458780a950-kube-api-access-r9g75\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.592805 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-slash\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq45l\" (UniqueName: \"kubernetes.io/projected/61dd6167-f489-4f80-9539-949a3a7f32e3-kube-api-access-bq45l\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysctl-d\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-cni-netd\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-systemd-units\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592893    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-slash\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-systemd\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592945    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-systemd-units\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592958    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-cni-netd\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592967    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.592983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592986    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.592996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysconfig\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593002    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysctl-d\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593020    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-systemd\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593028    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb99121e-615f-4ec2-a653-21458780a950-tmp\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593069    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593037    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysconfig\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-var-lib-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98bd3e18-c809-4fce-bdaf-217db4b24b83-konnectivity-ca\") pod \"konnectivity-agent-2qk6t\" (UID: \"98bd3e18-c809-4fce-bdaf-217db4b24b83\") " pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593117    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-var-lib-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593120    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb99121e-615f-4ec2-a653-21458780a950-etc-tuned\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-modprobe-d\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-lib-modules\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-node-log\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593238    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-ovnkube-config\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593271    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-run\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.593495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593283    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-node-log\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593308    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-modprobe-d\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593335    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-run-netns\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593341    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-lib-modules\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-run-netns\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593362    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-run\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593373    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-ovnkube-script-lib\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysctl-conf\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-systemd\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593452    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-ovn\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593495    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-ovn\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593538    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-run-systemd\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-env-overrides\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593567    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-sysctl-conf\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593591    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61dd6167-f489-4f80-9539-949a3a7f32e3-ovn-node-metrics-cert\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-sys\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-var-lib-kubelet\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-etc-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593688    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98bd3e18-c809-4fce-bdaf-217db4b24b83-konnectivity-ca\") pod \"konnectivity-agent-2qk6t\" (UID: \"98bd3e18-c809-4fce-bdaf-217db4b24b83\") " pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-kubernetes\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-host\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593757    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-sys\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-kubelet\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-log-socket\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98bd3e18-c809-4fce-bdaf-217db4b24b83-agent-certs\") pod \"konnectivity-agent-2qk6t\" (UID: \"98bd3e18-c809-4fce-bdaf-217db4b24b83\") " pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593840    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-cni-bin\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593904    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-cni-bin\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593956    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-var-lib-kubelet\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593994    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-env-overrides\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593991    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-ovnkube-config\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.594012    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61dd6167-f489-4f80-9539-949a3a7f32e3-ovnkube-script-lib\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.593997    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-etc-openvswitch\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.594046    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-log-socket\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.594076    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61dd6167-f489-4f80-9539-949a3a7f32e3-host-kubelet\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.594088    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-host\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.594920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.594093    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb99121e-615f-4ec2-a653-21458780a950-etc-kubernetes\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.595495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.595177    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb99121e-615f-4ec2-a653-21458780a950-etc-tuned\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.595495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.595392    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb99121e-615f-4ec2-a653-21458780a950-tmp\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.595896 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.595876    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61dd6167-f489-4f80-9539-949a3a7f32e3-ovn-node-metrics-cert\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.596124 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.596109    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98bd3e18-c809-4fce-bdaf-217db4b24b83-agent-certs\") pod \"konnectivity-agent-2qk6t\" (UID: \"98bd3e18-c809-4fce-bdaf-217db4b24b83\") " pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:03.600653 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.600630    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq45l\" (UniqueName: \"kubernetes.io/projected/61dd6167-f489-4f80-9539-949a3a7f32e3-kube-api-access-bq45l\") pod \"ovnkube-node-zd56w\" (UID: \"61dd6167-f489-4f80-9539-949a3a7f32e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.600945 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.600910    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9g75\" (UniqueName: \"kubernetes.io/projected/eb99121e-615f-4ec2-a653-21458780a950-kube-api-access-r9g75\") pod \"tuned-lrvbj\" (UID: \"eb99121e-615f-4ec2-a653-21458780a950\") " pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.702367 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.702348    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7nz9"
Jul 08 18:16:03.717289 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.717269    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ss2jv"
Jul 08 18:16:03.731228 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.731207    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pg98t"
Jul 08 18:16:03.734310 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.734293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb"
Jul 08 18:16:03.749832 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.749810    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-np8l6"
Jul 08 18:16:03.764295 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.764273    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hp7x6"
Jul 08 18:16:03.769189 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.769173    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:03.785902 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.785882    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lrvbj"
Jul 08 18:16:03.790313 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.790290    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:03.843799 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:03.843774    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb64130c7b615dfb98b4e6af62c0947.slice/crio-a7740d4791d95b853ce9dad0717a085d0fc1b6680c66507073aef51c062fa2f4 WatchSource:0}: Error finding container a7740d4791d95b853ce9dad0717a085d0fc1b6680c66507073aef51c062fa2f4: Status 404 returned error can't find the container with id a7740d4791d95b853ce9dad0717a085d0fc1b6680c66507073aef51c062fa2f4
Jul 08 18:16:03.844171 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:03.844135    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d9a6fed735c32fc3e333fe15459579.slice/crio-b1334346a588032206459f7d58ba152015e7b04c6c338078a1225a665277d7bd WatchSource:0}: Error finding container b1334346a588032206459f7d58ba152015e7b04c6c338078a1225a665277d7bd: Status 404 returned error can't find the container with id b1334346a588032206459f7d58ba152015e7b04c6c338078a1225a665277d7bd
Jul 08 18:16:03.849245 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.849228    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:16:03.997248 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.997181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:03.997248 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:03.997236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:03.997394 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.997327    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:03.997394 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.997380    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret podName:ac55bc61-004b-4008-91b5-011e34bb8b29 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:04.997365806 +0000 UTC m=+4.033022430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret") pod "global-pull-secret-syncer-c2ct2" (UID: "ac55bc61-004b-4008-91b5-011e34bb8b29") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:03.997465 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.997326    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:03.997465 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:03.997460    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:04.997446802 +0000 UTC m=+4.033103438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:04.023337 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:04.023315    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be65041_d2a5_4190_ac42_afc16106a8b4.slice/crio-eb8f6a05a8a933812eb590e9637da4b899e3b34caa544a05fc2f2b30a0120144 WatchSource:0}: Error finding container eb8f6a05a8a933812eb590e9637da4b899e3b34caa544a05fc2f2b30a0120144: Status 404 returned error can't find the container with id eb8f6a05a8a933812eb590e9637da4b899e3b34caa544a05fc2f2b30a0120144
Jul 08 18:16:04.098525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.098498    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:04.098676 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:04.098657    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:16:04.098718 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:04.098680    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:16:04.098718 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:04.098691    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ftwk7 for pod openshift-network-diagnostics/network-check-target-qq524: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:04.098783 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:04.098737    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7 podName:d1238578-f235-44bc-a0a6-16afae54021b nodeName:}" failed. No retries permitted until 2026-07-08 18:16:05.09872348 +0000 UTC m=+4.134380102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftwk7" (UniqueName: "kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7") pod "network-check-target-qq524" (UID: "d1238578-f235-44bc-a0a6-16afae54021b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:04.175031 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:04.175010    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90437aed_158a_4fe6_b1b3_6a4fd38d9c84.slice/crio-3b27c786875686bd16662fe96ef764e0f725feff679dfc103bbd357f2df61016 WatchSource:0}: Error finding container 3b27c786875686bd16662fe96ef764e0f725feff679dfc103bbd357f2df61016: Status 404 returned error can't find the container with id 3b27c786875686bd16662fe96ef764e0f725feff679dfc103bbd357f2df61016
Jul 08 18:16:04.201297 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.201274    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 18:16:04.209440 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:04.209413    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ad62ef_ab57_4306_8850_3a6030c73c66.slice/crio-76867da09670744d4fd42c50ba917ecca293593a8ddefe1554290777293dc600 WatchSource:0}: Error finding container 76867da09670744d4fd42c50ba917ecca293593a8ddefe1554290777293dc600: Status 404 returned error can't find the container with id 76867da09670744d4fd42c50ba917ecca293593a8ddefe1554290777293dc600
Jul 08 18:16:04.423672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.423602    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:11:03 +0000 UTC" deadline="2028-01-13 08:32:25.360206786 +0000 UTC"
Jul 08 18:16:04.423672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.423657    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13286h16m20.93655266s"
Jul 08 18:16:04.427770 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:04.427747    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a391cf_12fc_425e_800b_2269af2d1882.slice/crio-0880a2e156bded653b70d3c0a40ddb0aad0f89e057e35bcdf6751d75e2d17d3e WatchSource:0}: Error finding container 0880a2e156bded653b70d3c0a40ddb0aad0f89e057e35bcdf6751d75e2d17d3e: Status 404 returned error can't find the container with id 0880a2e156bded653b70d3c0a40ddb0aad0f89e057e35bcdf6751d75e2d17d3e
Jul 08 18:16:04.479972 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.479917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"d6d9a6fed735c32fc3e333fe15459579","Type":"ContainerStarted","Data":"b1334346a588032206459f7d58ba152015e7b04c6c338078a1225a665277d7bd"}
Jul 08 18:16:04.480892 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.480864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" event={"ID":"bbb64130c7b615dfb98b4e6af62c0947","Type":"ContainerStarted","Data":"a7740d4791d95b853ce9dad0717a085d0fc1b6680c66507073aef51c062fa2f4"}
Jul 08 18:16:04.481737 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.481720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb" event={"ID":"78a391cf-12fc-425e-800b-2269af2d1882","Type":"ContainerStarted","Data":"0880a2e156bded653b70d3c0a40ddb0aad0f89e057e35bcdf6751d75e2d17d3e"}
Jul 08 18:16:04.482594 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.482578    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" event={"ID":"65ad62ef-ab57-4306-8850-3a6030c73c66","Type":"ContainerStarted","Data":"76867da09670744d4fd42c50ba917ecca293593a8ddefe1554290777293dc600"}
Jul 08 18:16:04.483543 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.483516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7nz9" event={"ID":"90437aed-158a-4fe6-b1b3-6a4fd38d9c84","Type":"ContainerStarted","Data":"3b27c786875686bd16662fe96ef764e0f725feff679dfc103bbd357f2df61016"}
Jul 08 18:16:04.484465 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.484446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"4059941b904701aea25e8e00beec19c51d8ef759189b93b1521ce88052d7bf39"}
Jul 08 18:16:04.485401 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.485381    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lrvbj" event={"ID":"eb99121e-615f-4ec2-a653-21458780a950","Type":"ContainerStarted","Data":"e4b06b7ba097f538ec1708ed13da1beafd50b92c827cbfdfeea41dad5370a02b"}
Jul 08 18:16:04.486300 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:04.486283    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pg98t" event={"ID":"5be65041-d2a5-4190-ac42-afc16106a8b4","Type":"ContainerStarted","Data":"eb8f6a05a8a933812eb590e9637da4b899e3b34caa544a05fc2f2b30a0120144"}
Jul 08 18:16:05.004814 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:05.004776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:05.005008 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:05.004873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:05.005008 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.004991    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:05.005130 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.005051    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:07.005033667 +0000 UTC m=+6.040690292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:05.005545 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.005525    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:05.005614 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.005581    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret podName:ac55bc61-004b-4008-91b5-011e34bb8b29 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:07.005565943 +0000 UTC m=+6.041222568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret") pod "global-pull-secret-syncer-c2ct2" (UID: "ac55bc61-004b-4008-91b5-011e34bb8b29") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:05.105892 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:05.105857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:05.106062 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.106042    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:16:05.106062 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.106059    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:16:05.106206 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.106071    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ftwk7 for pod openshift-network-diagnostics/network-check-target-qq524: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:05.106206 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.106125    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7 podName:d1238578-f235-44bc-a0a6-16afae54021b nodeName:}" failed. No retries permitted until 2026-07-08 18:16:07.106107644 +0000 UTC m=+6.141764291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftwk7" (UniqueName: "kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7") pod "network-check-target-qq524" (UID: "d1238578-f235-44bc-a0a6-16afae54021b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:05.424795 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:05.424755    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:11:03 +0000 UTC" deadline="2028-01-22 07:23:52.591441257 +0000 UTC"
Jul 08 18:16:05.424795 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:05.424791    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13501h7m47.166654215s"
Jul 08 18:16:05.477663 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:05.477634    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:05.477827 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.477771    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:05.478203 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:05.478183    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:05.478296 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:05.478269    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:05.478377 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.478285    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:05.478435 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:05.478414    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:07.023218 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:07.023178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:07.023676 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:07.023254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:07.023676 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.023361    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:07.023676 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.023383    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:07.023676 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.023441    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret podName:ac55bc61-004b-4008-91b5-011e34bb8b29 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:11.023421768 +0000 UTC m=+10.059078408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret") pod "global-pull-secret-syncer-c2ct2" (UID: "ac55bc61-004b-4008-91b5-011e34bb8b29") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:07.023676 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.023461    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:11.0234506 +0000 UTC m=+10.059107224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:07.124115 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:07.124086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:07.124266 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.124220    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:16:07.124266 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.124235    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:16:07.124266 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.124245    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ftwk7 for pod openshift-network-diagnostics/network-check-target-qq524: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:07.124373 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.124290    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7 podName:d1238578-f235-44bc-a0a6-16afae54021b nodeName:}" failed. No retries permitted until 2026-07-08 18:16:11.124277697 +0000 UTC m=+10.159934320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftwk7" (UniqueName: "kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7") pod "network-check-target-qq524" (UID: "d1238578-f235-44bc-a0a6-16afae54021b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:07.476459 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:07.476420    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:07.476648 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:07.476426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:07.476648 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:07.476580    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:07.476648 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.476546    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:07.476808 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.476637    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:07.476808 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:07.476712    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:09.476342 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:09.476304    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:09.476785 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:09.476435    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:09.476850 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:09.476797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:09.476922 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:09.476905    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:09.476984 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:09.476940    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:09.477101 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:09.477065    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:11.054738 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:11.054651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:11.055312 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:11.054738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:11.055312 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.054846    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:11.055312 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.054916    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:19.054895311 +0000 UTC m=+18.090551963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:11.055312 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.054846    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:11.055312 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.055024    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret podName:ac55bc61-004b-4008-91b5-011e34bb8b29 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:19.055007234 +0000 UTC m=+18.090663856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret") pod "global-pull-secret-syncer-c2ct2" (UID: "ac55bc61-004b-4008-91b5-011e34bb8b29") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:11.155751 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:11.155707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:11.155924 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.155851    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:16:11.155924 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.155873    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:16:11.155924 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.155886    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ftwk7 for pod openshift-network-diagnostics/network-check-target-qq524: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:11.156064 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.155942    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7 podName:d1238578-f235-44bc-a0a6-16afae54021b nodeName:}" failed. No retries permitted until 2026-07-08 18:16:19.155923794 +0000 UTC m=+18.191580429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftwk7" (UniqueName: "kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7") pod "network-check-target-qq524" (UID: "d1238578-f235-44bc-a0a6-16afae54021b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:11.478690 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:11.478653    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:11.479075 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.479010    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:11.479621 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:11.479596    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:11.480222 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.479730    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:11.480222 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:11.479798    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:11.480222 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:11.479942    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:12.923293 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:12.923264    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece2b5df_6861_4a59_90cb_31dc56bc5c4a.slice/crio-d848e8044df54e094f8a04dad4ff19b70854413722bfcec804424e66be47c49b WatchSource:0}: Error finding container d848e8044df54e094f8a04dad4ff19b70854413722bfcec804424e66be47c49b: Status 404 returned error can't find the container with id d848e8044df54e094f8a04dad4ff19b70854413722bfcec804424e66be47c49b
Jul 08 18:16:12.950831 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:12.950802    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad07d4bb_fdd7_4a94_8d8d_155416ad676c.slice/crio-c85c0955b352d1f18454d667834fefa8408d491e14561a5f8fe9739fdc1057e6 WatchSource:0}: Error finding container c85c0955b352d1f18454d667834fefa8408d491e14561a5f8fe9739fdc1057e6: Status 404 returned error can't find the container with id c85c0955b352d1f18454d667834fefa8408d491e14561a5f8fe9739fdc1057e6
Jul 08 18:16:12.951897 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:12.951883    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bd3e18_c809_4fce_bdaf_217db4b24b83.slice/crio-8eeac9161f5722737f9db48c2d1e3f60f6cf8ed5ee4baa594049762a4c683c38 WatchSource:0}: Error finding container 8eeac9161f5722737f9db48c2d1e3f60f6cf8ed5ee4baa594049762a4c683c38: Status 404 returned error can't find the container with id 8eeac9161f5722737f9db48c2d1e3f60f6cf8ed5ee4baa594049762a4c683c38
Jul 08 18:16:13.476079 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.475963    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:13.476247 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.476074    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:13.476247 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:13.476087    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:13.476247 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.476113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:13.476247 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:13.476221    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:13.476464 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:13.476320    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:13.503666 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.503632    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lrvbj" event={"ID":"eb99121e-615f-4ec2-a653-21458780a950","Type":"ContainerStarted","Data":"ab4d16022fe0d4d0b309b0baa5acfd94839b2c263b88befbeb5ad637873f5648"}
Jul 08 18:16:13.505299 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.505275    2558 generic.go:356] "Generic (PLEG): container finished" podID="d6d9a6fed735c32fc3e333fe15459579" containerID="f9902e0734f74006d0fdfe6739fe92e4b666083cbea545e715dcc6fec5f0e764" exitCode=0
Jul 08 18:16:13.505434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.505381    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"d6d9a6fed735c32fc3e333fe15459579","Type":"ContainerDied","Data":"f9902e0734f74006d0fdfe6739fe92e4b666083cbea545e715dcc6fec5f0e764"}
Jul 08 18:16:13.507671 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.507309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" event={"ID":"bbb64130c7b615dfb98b4e6af62c0947","Type":"ContainerStarted","Data":"fcd1932f5ea1c7c913319dab0435d8303ca814243d46294b6d6e87baab5549b8"}
Jul 08 18:16:13.511785 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.511758    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2qk6t" event={"ID":"98bd3e18-c809-4fce-bdaf-217db4b24b83","Type":"ContainerStarted","Data":"8eeac9161f5722737f9db48c2d1e3f60f6cf8ed5ee4baa594049762a4c683c38"}
Jul 08 18:16:13.513712 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.513687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb" event={"ID":"78a391cf-12fc-425e-800b-2269af2d1882","Type":"ContainerStarted","Data":"5d34165ea3a3af095a03d6b4e0c98c583fe1b524e9adce4fa1ce19ca759542b6"}
Jul 08 18:16:13.515310 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.515284    2558 generic.go:356] "Generic (PLEG): container finished" podID="65ad62ef-ab57-4306-8850-3a6030c73c66" containerID="580333d6d04ba9b4e9949f5b46d47e2dc2a6d58eaa3297b1a848fa10949a0f4c" exitCode=0
Jul 08 18:16:13.515421 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.515384    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" event={"ID":"65ad62ef-ab57-4306-8850-3a6030c73c66","Type":"ContainerDied","Data":"580333d6d04ba9b4e9949f5b46d47e2dc2a6d58eaa3297b1a848fa10949a0f4c"}
Jul 08 18:16:13.517576 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.517538    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pg98t" event={"ID":"5be65041-d2a5-4190-ac42-afc16106a8b4","Type":"ContainerStarted","Data":"dba0beece60c44eedbe4c534b74f5212ead8755a68d5d5c59bafbcc7fb689b10"}
Jul 08 18:16:13.519335 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.519314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hp7x6" event={"ID":"ad07d4bb-fdd7-4a94-8d8d-155416ad676c","Type":"ContainerStarted","Data":"c85c0955b352d1f18454d667834fefa8408d491e14561a5f8fe9739fdc1057e6"}
Jul 08 18:16:13.520341 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.519674    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lrvbj" podStartSLOduration=3.714500755 podStartE2EDuration="12.51965769s" totalImagesPullingTime="8.805156935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:13.519005585 +0000 UTC m=+12.554662232" watchObservedRunningTime="2026-07-08 18:16:13.51965769 +0000 UTC m=+12.555314337"
Jul 08 18:16:13.522370 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.522344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-np8l6" event={"ID":"ece2b5df-6861-4a59-90cb-31dc56bc5c4a","Type":"ContainerStarted","Data":"d848e8044df54e094f8a04dad4ff19b70854413722bfcec804424e66be47c49b"}
Jul 08 18:16:13.546969 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.546732    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-160.ec2.internal" podStartSLOduration=11.546716951 podStartE2EDuration="11.546716951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:13.531126144 +0000 UTC m=+12.566782791" watchObservedRunningTime="2026-07-08 18:16:13.546716951 +0000 UTC m=+12.582373598"
Jul 08 18:16:13.600645 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:13.600253    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pg98t" podStartSLOduration=3.6947658839999997 podStartE2EDuration="12.600218011s" totalImagesPullingTime="8.905452127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:13.547943415 +0000 UTC m=+12.583600060" watchObservedRunningTime="2026-07-08 18:16:13.600218011 +0000 UTC m=+12.635874657"
Jul 08 18:16:14.533680 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:14.532197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" event={"ID":"d6d9a6fed735c32fc3e333fe15459579","Type":"ContainerStarted","Data":"c51c0a0f447f264c538894513d15dc395becf1485084b31ffe5ac1b796920b69"}
Jul 08 18:16:14.545358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:14.545309    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-160.ec2.internal" podStartSLOduration=12.545292455 podStartE2EDuration="12.545292455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:14.544763231 +0000 UTC m=+13.580419877" watchObservedRunningTime="2026-07-08 18:16:14.545292455 +0000 UTC m=+13.580949095"
Jul 08 18:16:15.475922 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:15.475786    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:15.475922 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:15.475783    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:15.475922 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:15.475881    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:15.475922 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:15.475892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:15.476172 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:15.475980    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:15.476172 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:15.476104    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:17.476002 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:17.475751    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:17.476459 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:17.475757    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:17.476459 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:17.476089    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:17.476459 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:17.475811    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:17.476459 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:17.476190    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:17.476459 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:17.476262    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:19.118541 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:19.118509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:19.118965 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:19.118553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:19.118965 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.118666    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:19.118965 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.118725    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:35.118709724 +0000 UTC m=+34.154366347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:19.118965 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.118674    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:19.118965 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.118805    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret podName:ac55bc61-004b-4008-91b5-011e34bb8b29 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:35.118787902 +0000 UTC m=+34.154444525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret") pod "global-pull-secret-syncer-c2ct2" (UID: "ac55bc61-004b-4008-91b5-011e34bb8b29") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:19.219096 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:19.219066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:19.219276 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.219203    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:16:19.219276 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.219227    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:16:19.219276 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.219239    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ftwk7 for pod openshift-network-diagnostics/network-check-target-qq524: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:19.219439 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.219301    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7 podName:d1238578-f235-44bc-a0a6-16afae54021b nodeName:}" failed. No retries permitted until 2026-07-08 18:16:35.219281687 +0000 UTC m=+34.254938322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftwk7" (UniqueName: "kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7") pod "network-check-target-qq524" (UID: "d1238578-f235-44bc-a0a6-16afae54021b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:19.476507 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:19.476476    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:19.476691 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:19.476514    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:19.476691 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:19.476483    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:19.476691 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.476600    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:19.476844 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.476684    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:19.476844 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:19.476775    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:21.476514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:21.476482    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:21.476966 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:21.476580    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:21.476966 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:21.476612    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:21.476966 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:21.476709    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:21.476966 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:21.476724    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:21.476966 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:21.476880    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:23.475504 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:23.475467    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:23.475949 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:23.475470    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:23.475949 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:23.475604    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:23.475949 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:23.475664    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:23.475949 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:23.475485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:23.475949 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:23.475751    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:25.475549 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:25.475519    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:25.476138 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:25.475516    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:25.476138 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:25.475654    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:25.476138 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:25.475530    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:25.476138 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:25.475727    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:25.476138 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:25.475833    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:26.279982 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.279818    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 18:16:26.448483 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.448402    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T18:16:26.279966488Z","UUID":"3735daf9-aad5-4693-8ab3-e861e4956d24","Handler":null,"Name":"","Endpoint":""}
Jul 08 18:16:26.450826 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.450295    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 18:16:26.450826 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.450334    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 18:16:26.555852 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.555830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb" event={"ID":"78a391cf-12fc-425e-800b-2269af2d1882","Type":"ContainerStarted","Data":"79091ac8fb940bdb695a980ea44d5ffd12f0a09b4c204bea153d6bcb41e039b4"}
Jul 08 18:16:26.557465 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.557446    2558 generic.go:356] "Generic (PLEG): container finished" podID="65ad62ef-ab57-4306-8850-3a6030c73c66" containerID="c1330957ddc9e6133f63df7ff0ce38e5760f1cb90138c978b5c23bdf4b33ecb7" exitCode=0
Jul 08 18:16:26.557542 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.557506    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" event={"ID":"65ad62ef-ab57-4306-8850-3a6030c73c66","Type":"ContainerDied","Data":"c1330957ddc9e6133f63df7ff0ce38e5760f1cb90138c978b5c23bdf4b33ecb7"}
Jul 08 18:16:26.558902 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.558885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7nz9" event={"ID":"90437aed-158a-4fe6-b1b3-6a4fd38d9c84","Type":"ContainerStarted","Data":"aeb4a1f03edb5053f71525035df0a4e456144bf2e658e3555d0666b6a8615e96"}
Jul 08 18:16:26.560280 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.560262    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hp7x6" event={"ID":"ad07d4bb-fdd7-4a94-8d8d-155416ad676c","Type":"ContainerStarted","Data":"43e315bdb2eef2b9e5f9b599598b315c169bdd4578b14c475d55468e5ccacfb3"}
Jul 08 18:16:26.563307 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.563289    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"2427237e3ec3a2c52b5e0b0c4e4295c3ac487317f248613a44d03e91cf50f7ff"}
Jul 08 18:16:26.563391 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.563340    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"a2bf819aeb15ee00e8f9bf45b56bdba58fc258295dfae1ad3ecfe1401f53d662"}
Jul 08 18:16:26.563391 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.563368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"8aa1010c6189f5db8e6c22120a89ca499d86d9b72f436965147c94d4a2005351"}
Jul 08 18:16:26.563474 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.563396    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"b1320dbf59d8a309a870732f344a917822211ac09aaa2138bf92436ccccdeeef"}
Jul 08 18:16:26.563474 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.563429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"f0576b15ba15ba8f017b2508045290962fea7be3c639e0cc0b07b08063d8aee1"}
Jul 08 18:16:26.564585 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.564567    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2qk6t" event={"ID":"98bd3e18-c809-4fce-bdaf-217db4b24b83","Type":"ContainerStarted","Data":"fb6a44bf5dbfa80c12c9d23a134447a4bdff092ea658222418af75827990e429"}
Jul 08 18:16:26.604243 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.604182    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q7nz9" podStartSLOduration=3.6687110929999998 podStartE2EDuration="25.604170354s" totalImagesPullingTime="21.935459261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:26.604101631 +0000 UTC m=+25.639758276" watchObservedRunningTime="2026-07-08 18:16:26.604170354 +0000 UTC m=+25.639826992"
Jul 08 18:16:26.617302 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.617271    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hp7x6" podStartSLOduration=12.459105718 podStartE2EDuration="25.617260205s" totalImagesPullingTime="13.158154487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:26.6171825 +0000 UTC m=+25.652839146" watchObservedRunningTime="2026-07-08 18:16:26.617260205 +0000 UTC m=+25.652916847"
Jul 08 18:16:26.630054 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:26.630022    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2qk6t" podStartSLOduration=12.464006275 podStartE2EDuration="25.63001359s" totalImagesPullingTime="13.166007315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:26.629980427 +0000 UTC m=+25.665637070" watchObservedRunningTime="2026-07-08 18:16:26.63001359 +0000 UTC m=+25.665670233"
Jul 08 18:16:27.475973 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:27.475944    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:27.476098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:27.475944    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:27.476098 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:27.476062    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:27.476098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:27.476071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:27.476243 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:27.476143    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:27.476278 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:27.476245    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:27.569089 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:27.569062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"d2b4aeacea943f28f39046365b07d6d13da1a8e494d3655fb91d8e975d828a4b"}
Jul 08 18:16:27.570324 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:27.570296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-np8l6" event={"ID":"ece2b5df-6861-4a59-90cb-31dc56bc5c4a","Type":"ContainerStarted","Data":"447b31d0f90622fd5552848793e8fff0fd232eef6054936c8188d7c32e008967"}
Jul 08 18:16:27.585042 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:27.585004    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-np8l6" podStartSLOduration=13.443866518 podStartE2EDuration="26.584993027s" totalImagesPullingTime="13.141126509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:27.584865914 +0000 UTC m=+26.620522576" watchObservedRunningTime="2026-07-08 18:16:27.584993027 +0000 UTC m=+26.620649689"
Jul 08 18:16:28.574489 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:28.574284    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb" event={"ID":"78a391cf-12fc-425e-800b-2269af2d1882","Type":"ContainerStarted","Data":"8a044d58da34fdceecc3a1ea16e649372278885164e7cbb3fd776eeb736bbafd"}
Jul 08 18:16:28.576356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:28.576334    2558 generic.go:356] "Generic (PLEG): container finished" podID="65ad62ef-ab57-4306-8850-3a6030c73c66" containerID="3f661569ff4b72cc2ce14383091e128529f94a338002b23218fef01970559a57" exitCode=0
Jul 08 18:16:28.576462 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:28.576409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" event={"ID":"65ad62ef-ab57-4306-8850-3a6030c73c66","Type":"ContainerDied","Data":"3f661569ff4b72cc2ce14383091e128529f94a338002b23218fef01970559a57"}
Jul 08 18:16:28.590928 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:28.590893    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxpjb" podStartSLOduration=4.818568206 podStartE2EDuration="27.590880374s" totalImagesPullingTime="22.772312168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:28.590822389 +0000 UTC m=+27.626479032" watchObservedRunningTime="2026-07-08 18:16:28.590880374 +0000 UTC m=+27.626537017"
Jul 08 18:16:29.475761 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:29.475728    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:29.475938 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:29.475723    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:29.475938 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:29.475863    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:29.475938 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:29.475911    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:29.476100 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:29.475996    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:29.476100 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:29.476044    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:29.581771 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:29.581740    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"8e5f59dc7c32ae0c79eebdfe4dd5b7f9d0c59a9c423cbdbab3bc6efe0a75f4dc"}
Jul 08 18:16:30.586455 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:30.586417    2558 generic.go:356] "Generic (PLEG): container finished" podID="65ad62ef-ab57-4306-8850-3a6030c73c66" containerID="75bef46ec11f0e85b2c01ea317ad1f36a5f421caeba13eeeb74eccc4aa4a46f5" exitCode=0
Jul 08 18:16:30.586912 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:30.586458    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" event={"ID":"65ad62ef-ab57-4306-8850-3a6030c73c66","Type":"ContainerDied","Data":"75bef46ec11f0e85b2c01ea317ad1f36a5f421caeba13eeeb74eccc4aa4a46f5"}
Jul 08 18:16:31.374256 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.373957    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:31.374537 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.374520    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:31.476166 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.476126    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:31.476309 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.476204    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:31.476309 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:31.476218    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:31.476431 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:31.476319    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:31.476431 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.476379    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:31.476528 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:31.476447    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:31.591529 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.591496    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" event={"ID":"61dd6167-f489-4f80-9539-949a3a7f32e3","Type":"ContainerStarted","Data":"6a197897001d9ca378bedbe38d98079b9836fdb1b06de4ff24dd0ad1b4224394"}
Jul 08 18:16:31.592029 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.591664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:31.592198 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.592181    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2qk6t"
Jul 08 18:16:31.618505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:31.618462    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w" podStartSLOduration=8.652084932 podStartE2EDuration="30.618449589s" totalImagesPullingTime="21.966364657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:31.618212141 +0000 UTC m=+30.653868786" watchObservedRunningTime="2026-07-08 18:16:31.618449589 +0000 UTC m=+30.654106233"
Jul 08 18:16:32.593931 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.593906    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:32.594439 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.593965    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:32.594439 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.594000    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:32.609285 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.609263    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:32.609478 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.609459    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:16:32.940235 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.940207    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c2ct2"]
Jul 08 18:16:32.940384 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.940370    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:32.940469 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:32.940451    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:32.943160 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.943132    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l27kq"]
Jul 08 18:16:32.943292 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.943252    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:32.943358 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:32.943340    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:32.943718 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.943699    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qq524"]
Jul 08 18:16:32.943809 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:32.943796    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:32.943897 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:32.943880    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:34.476118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:34.476080    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:34.476118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:34.476113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:34.476537 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:34.476221    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:34.476537 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:34.476254    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:34.476537 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:34.476292    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:34.476537 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:34.476379    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:35.141447 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:35.141406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:35.141607 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:35.141467    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:35.141607 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:35.141577    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:35.141607 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:35.141582    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:35.141750 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:35.141642    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret podName:ac55bc61-004b-4008-91b5-011e34bb8b29 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:07.141622579 +0000 UTC m=+66.177279217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret") pod "global-pull-secret-syncer-c2ct2" (UID: "ac55bc61-004b-4008-91b5-011e34bb8b29") : object "kube-system"/"original-pull-secret" not registered
Jul 08 18:16:35.141750 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:35.141665    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:07.141653314 +0000 UTC m=+66.177309948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 18:16:35.242033 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:35.242002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:35.242231 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:35.242123    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 18:16:35.242231 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:35.242138    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 18:16:35.242231 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:35.242163    2558 projected.go:196] Error preparing data for projected volume kube-api-access-ftwk7 for pod openshift-network-diagnostics/network-check-target-qq524: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:35.242231 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:35.242211    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7 podName:d1238578-f235-44bc-a0a6-16afae54021b nodeName:}" failed. No retries permitted until 2026-07-08 18:17:07.242194661 +0000 UTC m=+66.277851286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftwk7" (UniqueName: "kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7") pod "network-check-target-qq524" (UID: "d1238578-f235-44bc-a0a6-16afae54021b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 18:16:36.476425 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:36.476226    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:36.476857 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:36.476287    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:36.476857 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:36.476294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:36.476857 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:36.476508    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:36.476857 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:36.476628    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:36.476857 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:36.476716    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:37.606407 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:37.606339    2558 generic.go:356] "Generic (PLEG): container finished" podID="65ad62ef-ab57-4306-8850-3a6030c73c66" containerID="a1b49a050546898c4c3ae8656ae59068d71ff044e3fce0addc875fc61a4d8f1b" exitCode=0
Jul 08 18:16:37.606888 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:37.606401    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" event={"ID":"65ad62ef-ab57-4306-8850-3a6030c73c66","Type":"ContainerDied","Data":"a1b49a050546898c4c3ae8656ae59068d71ff044e3fce0addc875fc61a4d8f1b"}
Jul 08 18:16:38.476324 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.476298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:38.476537 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.476334    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:38.476537 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:38.476388    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2ct2" podUID="ac55bc61-004b-4008-91b5-011e34bb8b29"
Jul 08 18:16:38.476537 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.476412    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:38.476537 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:38.476480    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq524" podUID="d1238578-f235-44bc-a0a6-16afae54021b"
Jul 08 18:16:38.476663 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:38.476548    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:16:38.611035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.611007    2558 generic.go:356] "Generic (PLEG): container finished" podID="65ad62ef-ab57-4306-8850-3a6030c73c66" containerID="57ca73de48722b39a992edf0fe681228c0e1fc3363446dedb0163fbbe721d640" exitCode=0
Jul 08 18:16:38.611444 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.611057    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" event={"ID":"65ad62ef-ab57-4306-8850-3a6030c73c66","Type":"ContainerDied","Data":"57ca73de48722b39a992edf0fe681228c0e1fc3363446dedb0163fbbe721d640"}
Jul 08 18:16:38.658683 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.658654    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-160.ec2.internal" event="NodeReady"
Jul 08 18:16:38.658830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.658809    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 18:16:38.690216 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.690193    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"]
Jul 08 18:16:38.694162 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.694111    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"]
Jul 08 18:16:38.694270 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.694249    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"
Jul 08 18:16:38.696764 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.696744    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 18:16:38.696883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.696759    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 18:16:38.696883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.696759    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-b9k5q\""
Jul 08 18:16:38.697094 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.697072    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 18:16:38.697205 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.697077    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 18:16:38.697205 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.697112    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85d8956cc4-hnczr"]
Jul 08 18:16:38.697305 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.697222    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.700313 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.700295    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"]
Jul 08 18:16:38.700424 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.700410    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.700728 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.700701    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 18:16:38.700870 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.700853    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 18:16:38.701006 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.700991    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 18:16:38.701321 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.701303    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 18:16:38.703107 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.703069    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.703216 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.703199    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 18:16:38.703449 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.703429    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 18:16:38.703832 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.703814    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 18:16:38.703907 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.703895    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xmj8w\""
Jul 08 18:16:38.705914 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.705896    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 18:16:38.706092 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.706073    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"]
Jul 08 18:16:38.706728 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.706709    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v59xd"]
Jul 08 18:16:38.710323 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.710299    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"]
Jul 08 18:16:38.710406 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.710332    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"]
Jul 08 18:16:38.710622 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.710410    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v59xd"
Jul 08 18:16:38.710701 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.710668    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85d8956cc4-hnczr"]
Jul 08 18:16:38.711163 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.711130    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 18:16:38.712999 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.712982    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 18:16:38.713431 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.713409    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-75wcg\""
Jul 08 18:16:38.713514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.713500    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 18:16:38.713627 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.713612    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 18:16:38.715315 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.715298    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvw86"]
Jul 08 18:16:38.718919 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.718847    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.723245 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.721253    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 18:16:38.723245 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.721387    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d7khc\""
Jul 08 18:16:38.723245 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.721479    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 18:16:38.723777 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.723764    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v59xd"]
Jul 08 18:16:38.733143 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.733095    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvw86"]
Jul 08 18:16:38.872135 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7np7p\" (UniqueName: \"kubernetes.io/projected/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-kube-api-access-7np7p\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.872135 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-bound-sa-token\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.872338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t95cl\" (UniqueName: \"kubernetes.io/projected/26e6463d-7875-4687-88cc-a68d08119fb8-kube-api-access-t95cl\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.872338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-ca\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.872338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.872338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.872338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872310    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-config-volume\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.872481 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b8da009-2355-4c2c-8df2-8f99897328a2-ca-trust-extracted\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.872481 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-image-registry-private-configuration\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.872481 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872379    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-certificates\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.872481 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b90ffd34-ed4c-4158-8256-b2d2c107666e-cert\") pod \"ingress-canary-v59xd\" (UID: \"b90ffd34-ed4c-4158-8256-b2d2c107666e\") " pod="openshift-ingress-canary/ingress-canary-v59xd"
Jul 08 18:16:38.872481 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-tmp-dir\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.872481 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1d019c6-cfb6-4226-8a13-d4689118f6e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c65c488-gzwcv\" (UID: \"a1d019c6-cfb6-4226-8a13-d4689118f6e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"
Jul 08 18:16:38.872646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbmpz\" (UniqueName: \"kubernetes.io/projected/cf08d411-e86d-4d76-b0be-c46f5719eeb2-kube-api-access-tbmpz\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.872646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-trusted-ca\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.872646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-hub\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.872646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz2g2\" (UniqueName: \"kubernetes.io/projected/a1d019c6-cfb6-4226-8a13-d4689118f6e9-kube-api-access-mz2g2\") pod \"managed-serviceaccount-addon-agent-75c65c488-gzwcv\" (UID: \"a1d019c6-cfb6-4226-8a13-d4689118f6e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"
Jul 08 18:16:38.872646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.872646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9kdj\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-kube-api-access-v9kdj\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.872646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872625    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26e6463d-7875-4687-88cc-a68d08119fb8-tmp\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.872646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872640    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/26e6463d-7875-4687-88cc-a68d08119fb8-klusterlet-config\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.872873 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872679    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-installation-pull-secrets\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.872873 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf08d411-e86d-4d76-b0be-c46f5719eeb2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.872873 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.872873 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.872750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2frsh\" (UniqueName: \"kubernetes.io/projected/b90ffd34-ed4c-4158-8256-b2d2c107666e-kube-api-access-2frsh\") pod \"ingress-canary-v59xd\" (UID: \"b90ffd34-ed4c-4158-8256-b2d2c107666e\") " pod="openshift-ingress-canary/ingress-canary-v59xd"
Jul 08 18:16:38.973441 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-certificates\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.973441 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b90ffd34-ed4c-4158-8256-b2d2c107666e-cert\") pod \"ingress-canary-v59xd\" (UID: \"b90ffd34-ed4c-4158-8256-b2d2c107666e\") " pod="openshift-ingress-canary/ingress-canary-v59xd"
Jul 08 18:16:38.973606 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-tmp-dir\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.973606 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1d019c6-cfb6-4226-8a13-d4689118f6e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c65c488-gzwcv\" (UID: \"a1d019c6-cfb6-4226-8a13-d4689118f6e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"
Jul 08 18:16:38.973671 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973605    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbmpz\" (UniqueName: \"kubernetes.io/projected/cf08d411-e86d-4d76-b0be-c46f5719eeb2-kube-api-access-tbmpz\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.973671 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-trusted-ca\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.973758 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973670    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-hub\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.973956 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973910    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-tmp-dir\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.974023 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz2g2\" (UniqueName: \"kubernetes.io/projected/a1d019c6-cfb6-4226-8a13-d4689118f6e9-kube-api-access-mz2g2\") pod \"managed-serviceaccount-addon-agent-75c65c488-gzwcv\" (UID: \"a1d019c6-cfb6-4226-8a13-d4689118f6e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"
Jul 08 18:16:38.974023 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.973985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.974023 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9kdj\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-kube-api-access-v9kdj\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.974200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26e6463d-7875-4687-88cc-a68d08119fb8-tmp\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.974200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/26e6463d-7875-4687-88cc-a68d08119fb8-klusterlet-config\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.974200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974089    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-installation-pull-secrets\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.974200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf08d411-e86d-4d76-b0be-c46f5719eeb2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.974200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.974200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974179    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-certificates\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.974495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2frsh\" (UniqueName: \"kubernetes.io/projected/b90ffd34-ed4c-4158-8256-b2d2c107666e-kube-api-access-2frsh\") pod \"ingress-canary-v59xd\" (UID: \"b90ffd34-ed4c-4158-8256-b2d2c107666e\") " pod="openshift-ingress-canary/ingress-canary-v59xd"
Jul 08 18:16:38.974495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np7p\" (UniqueName: \"kubernetes.io/projected/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-kube-api-access-7np7p\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.974495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-bound-sa-token\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.974495 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:38.974299    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:16:38.974495 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:38.974314    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d8956cc4-hnczr: secret "image-registry-tls" not found
Jul 08 18:16:38.974495 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:38.974378    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls podName:8b8da009-2355-4c2c-8df2-8f99897328a2 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:39.474359284 +0000 UTC m=+38.510015914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls") pod "image-registry-85d8956cc4-hnczr" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2") : secret "image-registry-tls" not found
Jul 08 18:16:38.974792 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974297    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t95cl\" (UniqueName: \"kubernetes.io/projected/26e6463d-7875-4687-88cc-a68d08119fb8-kube-api-access-t95cl\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.974792 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:38.974559    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:16:38.974792 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974577    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-ca\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.974792 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.974792 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.974792 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-config-volume\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.974792 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b8da009-2355-4c2c-8df2-8f99897328a2-ca-trust-extracted\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.974792 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-image-registry-private-configuration\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.975261 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.974834    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-trusted-ca\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.975261 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:38.975242    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls podName:b20261f6-ce00-4423-8a9a-eb2e0d60e8e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:39.475176177 +0000 UTC m=+38.510832805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls") pod "dns-default-gvw86" (UID: "b20261f6-ce00-4423-8a9a-eb2e0d60e8e7") : secret "dns-default-metrics-tls" not found
Jul 08 18:16:38.975818 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.975515    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26e6463d-7875-4687-88cc-a68d08119fb8-tmp\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.975908 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.975825    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-config-volume\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.976289 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.976260    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b8da009-2355-4c2c-8df2-8f99897328a2-ca-trust-extracted\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.976400 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.976369    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf08d411-e86d-4d76-b0be-c46f5719eeb2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.978422 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.978400    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-image-registry-private-configuration\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.978582 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.978558    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b90ffd34-ed4c-4158-8256-b2d2c107666e-cert\") pod \"ingress-canary-v59xd\" (UID: \"b90ffd34-ed4c-4158-8256-b2d2c107666e\") " pod="openshift-ingress-canary/ingress-canary-v59xd"
Jul 08 18:16:38.978672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.978594    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.978672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.978564    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-ca\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.978672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.978618    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.978955 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.978936    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf08d411-e86d-4d76-b0be-c46f5719eeb2-hub\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.979428 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.979408    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1d019c6-cfb6-4226-8a13-d4689118f6e9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c65c488-gzwcv\" (UID: \"a1d019c6-cfb6-4226-8a13-d4689118f6e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"
Jul 08 18:16:38.979535 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.979494    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/26e6463d-7875-4687-88cc-a68d08119fb8-klusterlet-config\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.979595 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.979570    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-installation-pull-secrets\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.983528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.983475    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbmpz\" (UniqueName: \"kubernetes.io/projected/cf08d411-e86d-4d76-b0be-c46f5719eeb2-kube-api-access-tbmpz\") pod \"cluster-proxy-proxy-agent-5c6b469bf6-bstpf\" (UID: \"cf08d411-e86d-4d76-b0be-c46f5719eeb2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:38.983966 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.983944    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7np7p\" (UniqueName: \"kubernetes.io/projected/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-kube-api-access-7np7p\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:38.984048 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.983949    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz2g2\" (UniqueName: \"kubernetes.io/projected/a1d019c6-cfb6-4226-8a13-d4689118f6e9-kube-api-access-mz2g2\") pod \"managed-serviceaccount-addon-agent-75c65c488-gzwcv\" (UID: \"a1d019c6-cfb6-4226-8a13-d4689118f6e9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"
Jul 08 18:16:38.984233 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.984215    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9kdj\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-kube-api-access-v9kdj\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:38.984423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.984402    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t95cl\" (UniqueName: \"kubernetes.io/projected/26e6463d-7875-4687-88cc-a68d08119fb8-kube-api-access-t95cl\") pod \"klusterlet-addon-workmgr-65fdd6689f-zjpss\" (UID: \"26e6463d-7875-4687-88cc-a68d08119fb8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:38.984686 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.984671    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2frsh\" (UniqueName: \"kubernetes.io/projected/b90ffd34-ed4c-4158-8256-b2d2c107666e-kube-api-access-2frsh\") pod \"ingress-canary-v59xd\" (UID: \"b90ffd34-ed4c-4158-8256-b2d2c107666e\") " pod="openshift-ingress-canary/ingress-canary-v59xd"
Jul 08 18:16:38.984719 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:38.984711    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-bound-sa-token\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:39.015734 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.015713    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"
Jul 08 18:16:39.022482 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.022464    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:16:39.042626 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.042606    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:39.047495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.047476    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v59xd"
Jul 08 18:16:39.182100 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.181898    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv"]
Jul 08 18:16:39.185133 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.185109    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"]
Jul 08 18:16:39.186211 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:39.186188    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1d019c6_cfb6_4226_8a13_d4689118f6e9.slice/crio-a2868fc10c04d628f41f565eae9a7fc2e23b5c699be01880dbaedb8b0e2fea83 WatchSource:0}: Error finding container a2868fc10c04d628f41f565eae9a7fc2e23b5c699be01880dbaedb8b0e2fea83: Status 404 returned error can't find the container with id a2868fc10c04d628f41f565eae9a7fc2e23b5c699be01880dbaedb8b0e2fea83
Jul 08 18:16:39.187102 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:39.187060    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf08d411_e86d_4d76_b0be_c46f5719eeb2.slice/crio-1e07a7c5ce036e4f4007c4df8b53b574d4c27490b2111006d9904cee26876448 WatchSource:0}: Error finding container 1e07a7c5ce036e4f4007c4df8b53b574d4c27490b2111006d9904cee26876448: Status 404 returned error can't find the container with id 1e07a7c5ce036e4f4007c4df8b53b574d4c27490b2111006d9904cee26876448
Jul 08 18:16:39.195671 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.195644    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"]
Jul 08 18:16:39.198086 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:39.198055    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e6463d_7875_4687_88cc_a68d08119fb8.slice/crio-0c51e7008470ef23f8c4ce86e16bb541b196939b2b9b2e80f607fa47931475b3 WatchSource:0}: Error finding container 0c51e7008470ef23f8c4ce86e16bb541b196939b2b9b2e80f607fa47931475b3: Status 404 returned error can't find the container with id 0c51e7008470ef23f8c4ce86e16bb541b196939b2b9b2e80f607fa47931475b3
Jul 08 18:16:39.198542 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.198521    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v59xd"]
Jul 08 18:16:39.201571 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:16:39.201547    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90ffd34_ed4c_4158_8256_b2d2c107666e.slice/crio-3500f36869f91053ca7311bba15c56d5ca89a910dea4f2559d0dcb5766aba24d WatchSource:0}: Error finding container 3500f36869f91053ca7311bba15c56d5ca89a910dea4f2559d0dcb5766aba24d: Status 404 returned error can't find the container with id 3500f36869f91053ca7311bba15c56d5ca89a910dea4f2559d0dcb5766aba24d
Jul 08 18:16:39.478184 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.478136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:39.478347 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.478203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:39.478347 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:39.478296    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:16:39.478464 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:39.478348    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls podName:b20261f6-ce00-4423-8a9a-eb2e0d60e8e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:40.478334359 +0000 UTC m=+39.513990982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls") pod "dns-default-gvw86" (UID: "b20261f6-ce00-4423-8a9a-eb2e0d60e8e7") : secret "dns-default-metrics-tls" not found
Jul 08 18:16:39.478464 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:39.478299    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:16:39.478464 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:39.478383    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d8956cc4-hnczr: secret "image-registry-tls" not found
Jul 08 18:16:39.478464 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:39.478424    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls podName:8b8da009-2355-4c2c-8df2-8f99897328a2 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:40.478413813 +0000 UTC m=+39.514070450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls") pod "image-registry-85d8956cc4-hnczr" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2") : secret "image-registry-tls" not found
Jul 08 18:16:39.614583 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.614553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v59xd" event={"ID":"b90ffd34-ed4c-4158-8256-b2d2c107666e","Type":"ContainerStarted","Data":"3500f36869f91053ca7311bba15c56d5ca89a910dea4f2559d0dcb5766aba24d"}
Jul 08 18:16:39.615864 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.615830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" event={"ID":"cf08d411-e86d-4d76-b0be-c46f5719eeb2","Type":"ContainerStarted","Data":"1e07a7c5ce036e4f4007c4df8b53b574d4c27490b2111006d9904cee26876448"}
Jul 08 18:16:39.617025 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.617002    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv" event={"ID":"a1d019c6-cfb6-4226-8a13-d4689118f6e9","Type":"ContainerStarted","Data":"a2868fc10c04d628f41f565eae9a7fc2e23b5c699be01880dbaedb8b0e2fea83"}
Jul 08 18:16:39.620798 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.620759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" event={"ID":"65ad62ef-ab57-4306-8850-3a6030c73c66","Type":"ContainerStarted","Data":"43aa99b8d5f709d3e34e12e8c7a6f052ae63f6d0b4d55f2f56075eb848463364"}
Jul 08 18:16:39.622269 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.622236    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss" event={"ID":"26e6463d-7875-4687-88cc-a68d08119fb8","Type":"ContainerStarted","Data":"0c51e7008470ef23f8c4ce86e16bb541b196939b2b9b2e80f607fa47931475b3"}
Jul 08 18:16:39.645167 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.645099    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ss2jv" podStartSLOduration=8.136740433 podStartE2EDuration="38.645080567s" totalImagesPullingTime="30.508340134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:39.643567023 +0000 UTC m=+38.679223865" watchObservedRunningTime="2026-07-08 18:16:39.645080567 +0000 UTC m=+38.680737212"
Jul 08 18:16:39.781312 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.781230    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:39.865262 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:39.865078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:40.476870 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.476063    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:16:40.476870 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.476536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:16:40.476870 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.476831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:16:40.480594 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.479195    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 18:16:40.480594 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.479451    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 18:16:40.480594 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.480022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hn7hw\""
Jul 08 18:16:40.480594 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.480278    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 18:16:40.480594 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.480476    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4rm5\""
Jul 08 18:16:40.480890 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.480694    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 18:16:40.486104 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.486079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:40.486244 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.486140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:40.486343 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:40.486326    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:16:40.486462 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:40.486449    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls podName:b20261f6-ce00-4423-8a9a-eb2e0d60e8e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:42.486431229 +0000 UTC m=+41.522087855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls") pod "dns-default-gvw86" (UID: "b20261f6-ce00-4423-8a9a-eb2e0d60e8e7") : secret "dns-default-metrics-tls" not found
Jul 08 18:16:40.486937 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:40.486920    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:16:40.487012 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:40.486940    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d8956cc4-hnczr: secret "image-registry-tls" not found
Jul 08 18:16:40.487012 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:40.486983    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls podName:8b8da009-2355-4c2c-8df2-8f99897328a2 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:42.486969309 +0000 UTC m=+41.522625934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls") pod "image-registry-85d8956cc4-hnczr" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2") : secret "image-registry-tls" not found
Jul 08 18:16:40.907887 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.907839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:40.971625 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:40.971562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:41.948964 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:41.948932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:42.050825 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.050758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:42.105928 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.105859    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:42.505382 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.505350    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:42.505548 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.505414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:42.505756 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:42.505647    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:16:42.505756 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:42.505697    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:16:42.505756 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:42.505710    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d8956cc4-hnczr: secret "image-registry-tls" not found
Jul 08 18:16:42.505756 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:42.505720    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls podName:b20261f6-ce00-4423-8a9a-eb2e0d60e8e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:46.5056998 +0000 UTC m=+45.541356440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls") pod "dns-default-gvw86" (UID: "b20261f6-ce00-4423-8a9a-eb2e0d60e8e7") : secret "dns-default-metrics-tls" not found
Jul 08 18:16:42.505756 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:42.505743    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls podName:8b8da009-2355-4c2c-8df2-8f99897328a2 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:46.505732866 +0000 UTC m=+45.541389496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls") pod "image-registry-85d8956cc4-hnczr" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2") : secret "image-registry-tls" not found
Jul 08 18:16:42.618429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.618393    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:42.685419 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.685317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:42.759659 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.759576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:42.834778 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.834738    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:42.935207 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:42.935169    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:43.036040 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:43.035893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:43.285085 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:43.285047    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:43.342052 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:43.341952    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:44.093691 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:44.093657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:44.145199 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:44.145167    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:44.491722 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:44.491666    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:44.591665 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:44.591628    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:46.540330 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.540092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:46.540855 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.540361    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:46.540855 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:46.540272    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:16:46.540855 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:46.540419    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d8956cc4-hnczr: secret "image-registry-tls" not found
Jul 08 18:16:46.540855 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:46.540489    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls podName:8b8da009-2355-4c2c-8df2-8f99897328a2 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:54.54046089 +0000 UTC m=+53.576117532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls") pod "image-registry-85d8956cc4-hnczr" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2") : secret "image-registry-tls" not found
Jul 08 18:16:46.540855 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:46.540526    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:16:46.540855 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:46.540572    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls podName:b20261f6-ce00-4423-8a9a-eb2e0d60e8e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:54.540562099 +0000 UTC m=+53.576218724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls") pod "dns-default-gvw86" (UID: "b20261f6-ce00-4423-8a9a-eb2e0d60e8e7") : secret "dns-default-metrics-tls" not found
Jul 08 18:16:46.651652 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.651615    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss" event={"ID":"26e6463d-7875-4687-88cc-a68d08119fb8","Type":"ContainerStarted","Data":"8643332b30632fb5bf93becae3815de88430da8f27098085193ff32fc014e391"}
Jul 08 18:16:46.651833 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.651806    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:46.653266 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.653234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v59xd" event={"ID":"b90ffd34-ed4c-4158-8256-b2d2c107666e","Type":"ContainerStarted","Data":"e28ee7e2946c9958e1dbb5d6858e339de3c859fa0e80dcb6df925febc0045259"}
Jul 08 18:16:46.653787 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.653759    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss"
Jul 08 18:16:46.655426 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.655405    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" event={"ID":"cf08d411-e86d-4d76-b0be-c46f5719eeb2","Type":"ContainerStarted","Data":"8af46a6665605831f6143066ba278f25a74ed5cf7de60517b6f6927a8c606796"}
Jul 08 18:16:46.655512 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.655441    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" event={"ID":"cf08d411-e86d-4d76-b0be-c46f5719eeb2","Type":"ContainerStarted","Data":"cf09252c16927a879a0d095a608c4587aa608ccf29ad538fcbc98298c95b787e"}
Jul 08 18:16:46.655512 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.655457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" event={"ID":"cf08d411-e86d-4d76-b0be-c46f5719eeb2","Type":"ContainerStarted","Data":"592016f0d0224370fef8ad1f69005e4bde50b1f4b2c754236189bf58eb4550fe"}
Jul 08 18:16:46.656806 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.656778    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv" event={"ID":"a1d019c6-cfb6-4226-8a13-d4689118f6e9","Type":"ContainerStarted","Data":"2c3ff3daf8c14c4bdaeee05d0b9c4b61807ba7c318aceb9acd268ebcaf7ae523"}
Jul 08 18:16:46.669253 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.669212    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65fdd6689f-zjpss" podStartSLOduration=31.730892073 podStartE2EDuration="38.669198642s" totalImagesPullingTime="6.938306569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:46.668384388 +0000 UTC m=+45.704041048" watchObservedRunningTime="2026-07-08 18:16:46.669198642 +0000 UTC m=+45.704855278"
Jul 08 18:16:46.687342 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.687305    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c65c488-gzwcv" podStartSLOduration=31.753067509 podStartE2EDuration="38.68729508s" totalImagesPullingTime="6.934227571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:46.686564898 +0000 UTC m=+45.722221765" watchObservedRunningTime="2026-07-08 18:16:46.68729508 +0000 UTC m=+45.722951703"
Jul 08 18:16:46.723410 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.723373    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" podStartSLOduration=31.789039849 podStartE2EDuration="38.723360811s" totalImagesPullingTime="6.934320962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:46.70557183 +0000 UTC m=+45.741228501" watchObservedRunningTime="2026-07-08 18:16:46.723360811 +0000 UTC m=+45.759017449"
Jul 08 18:16:46.735812 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.735789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:46.739192 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.739144    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v59xd" podStartSLOduration=1.819134804 podStartE2EDuration="8.739131979s" totalImagesPullingTime="6.919997175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:46.738697822 +0000 UTC m=+45.774354464" watchObservedRunningTime="2026-07-08 18:16:46.739131979 +0000 UTC m=+45.774788624"
Jul 08 18:16:46.837483 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:46.837457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:48.955389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:48.955353    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:49.013397 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:49.013368    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:50.929227 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:50.929190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:53.078287 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:53.078242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:53.178270 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:53.178233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:16:54.601668 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:54.601627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:16:54.602210 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:16:54.601731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:16:54.602210 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:54.601788    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:16:54.602210 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:54.601866    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls podName:b20261f6-ce00-4423-8a9a-eb2e0d60e8e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:10.601846195 +0000 UTC m=+69.637502821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls") pod "dns-default-gvw86" (UID: "b20261f6-ce00-4423-8a9a-eb2e0d60e8e7") : secret "dns-default-metrics-tls" not found
Jul 08 18:16:54.602210 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:54.601875    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:16:54.602210 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:54.601888    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d8956cc4-hnczr: secret "image-registry-tls" not found
Jul 08 18:16:54.602210 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:16:54.601935    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls podName:8b8da009-2355-4c2c-8df2-8f99897328a2 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:10.601920443 +0000 UTC m=+69.637577070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls") pod "image-registry-85d8956cc4-hnczr" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2") : secret "image-registry-tls" not found
Jul 08 18:17:04.615614 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:04.615583    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zd56w"
Jul 08 18:17:04.645389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:04.645359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:04.742468 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:04.742437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:04.841389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:04.841355    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:04.907477 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:04.907447    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:05.010543 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:05.010510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:05.081847 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:05.081814    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:05.179540 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:05.179464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:07.010585 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.010550    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:07.111245 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.111214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:07.207196 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.207137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:17:07.207389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.207224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:17:07.209312 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.209289    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 18:17:07.209392 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.209350    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 18:17:07.211610 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.211582    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:07.218213 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:07.218196    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 18:17:07.218281 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:07.218267    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:11.218248115 +0000 UTC m=+130.253904740 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : secret "metrics-daemon-secret" not found
Jul 08 18:17:07.221951 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.221921    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ac55bc61-004b-4008-91b5-011e34bb8b29-original-pull-secret\") pod \"global-pull-secret-syncer-c2ct2\" (UID: \"ac55bc61-004b-4008-91b5-011e34bb8b29\") " pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:17:07.307640 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.307539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:17:07.309936 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.309916    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 18:17:07.313657 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.313624    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:07.320723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.320698    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 18:17:07.331944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.331910    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftwk7\" (UniqueName: \"kubernetes.io/projected/d1238578-f235-44bc-a0a6-16afae54021b-kube-api-access-ftwk7\") pod \"network-check-target-qq524\" (UID: \"d1238578-f235-44bc-a0a6-16afae54021b\") " pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:17:07.413187 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.413136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:07.506464 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.506432    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2ct2"
Jul 08 18:17:07.517368 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.517346    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4rm5\""
Jul 08 18:17:07.525368 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.525346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:17:07.640528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.640496    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c2ct2"]
Jul 08 18:17:07.643326 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:17:07.643301    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac55bc61_004b_4008_91b5_011e34bb8b29.slice/crio-5b05fa728c2536c58b6a8a723534e54b9731c8ca170b61180a594a850d6e18de WatchSource:0}: Error finding container 5b05fa728c2536c58b6a8a723534e54b9731c8ca170b61180a594a850d6e18de: Status 404 returned error can't find the container with id 5b05fa728c2536c58b6a8a723534e54b9731c8ca170b61180a594a850d6e18de
Jul 08 18:17:07.654977 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.654951    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qq524"]
Jul 08 18:17:07.657493 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:17:07.657469    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1238578_f235_44bc_a0a6_16afae54021b.slice/crio-66c91d8906b94782f16ca57388af2ab3651956986c87b7f4965c069f4bf672d4 WatchSource:0}: Error finding container 66c91d8906b94782f16ca57388af2ab3651956986c87b7f4965c069f4bf672d4: Status 404 returned error can't find the container with id 66c91d8906b94782f16ca57388af2ab3651956986c87b7f4965c069f4bf672d4
Jul 08 18:17:07.717378 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.717346    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qq524" event={"ID":"d1238578-f235-44bc-a0a6-16afae54021b","Type":"ContainerStarted","Data":"66c91d8906b94782f16ca57388af2ab3651956986c87b7f4965c069f4bf672d4"}
Jul 08 18:17:07.718335 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.718310    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c2ct2" event={"ID":"ac55bc61-004b-4008-91b5-011e34bb8b29","Type":"ContainerStarted","Data":"5b05fa728c2536c58b6a8a723534e54b9731c8ca170b61180a594a850d6e18de"}
Jul 08 18:17:07.962978 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:07.962947    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:08.060523 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:08.060480    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:10.634692 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:10.634652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:17:10.635297 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:10.634724    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:17:10.635297 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:10.634837    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:17:10.635297 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:10.634862    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d8956cc4-hnczr: secret "image-registry-tls" not found
Jul 08 18:17:10.635297 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:10.634927    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls podName:8b8da009-2355-4c2c-8df2-8f99897328a2 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:42.634905577 +0000 UTC m=+101.670562228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls") pod "image-registry-85d8956cc4-hnczr" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2") : secret "image-registry-tls" not found
Jul 08 18:17:10.635297 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:10.634842    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:17:10.635297 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:10.635011    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls podName:b20261f6-ce00-4423-8a9a-eb2e0d60e8e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:42.634986646 +0000 UTC m=+101.670643275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls") pod "dns-default-gvw86" (UID: "b20261f6-ce00-4423-8a9a-eb2e0d60e8e7") : secret "dns-default-metrics-tls" not found
Jul 08 18:17:12.740276 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:12.740188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qq524" event={"ID":"d1238578-f235-44bc-a0a6-16afae54021b","Type":"ContainerStarted","Data":"27e640fe05bf9e655e8f5b4d254bc8e6f45a8b9f0078826d39db180019bba727"}
Jul 08 18:17:12.740698 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:12.740315    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:17:12.741790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:12.741763    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c2ct2" event={"ID":"ac55bc61-004b-4008-91b5-011e34bb8b29","Type":"ContainerStarted","Data":"7438dd1492770384a7c41457f79532b88e04c81c4c94dbbf2b7030ba1632f0c7"}
Jul 08 18:17:12.757955 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:12.757908    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qq524" podStartSLOduration=66.935473344 podStartE2EDuration="1m11.757894343s" totalImagesPullingTime="4.822420999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:12.756806365 +0000 UTC m=+71.792463011" watchObservedRunningTime="2026-07-08 18:17:12.757894343 +0000 UTC m=+71.793550988"
Jul 08 18:17:12.771103 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:12.771060    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c2ct2" podStartSLOduration=66.892312714 podStartE2EDuration="1m11.771043995s" totalImagesPullingTime="4.878731281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:12.77087126 +0000 UTC m=+71.806527904" watchObservedRunningTime="2026-07-08 18:17:12.771043995 +0000 UTC m=+71.806700640"
Jul 08 18:17:12.961732 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:12.961701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:13.023095 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:13.023011    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:18.923981 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:18.923941    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:18.976981 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:18.976941    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:22.817633 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:22.817591    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:23.103597 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:23.103501    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:23.202760 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:23.202720    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:31.046221 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:31.046173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:34.163350 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:34.163313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:42.677819 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:42.677785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:17:42.678222 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:42.677836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:17:42.678222 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:42.677934    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 18:17:42.678222 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:42.677938    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 18:17:42.678222 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:42.677953    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85d8956cc4-hnczr: secret "image-registry-tls" not found
Jul 08 18:17:42.678222 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:42.678006    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls podName:8b8da009-2355-4c2c-8df2-8f99897328a2 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:46.677991418 +0000 UTC m=+165.713648045 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls") pod "image-registry-85d8956cc4-hnczr" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2") : secret "image-registry-tls" not found
Jul 08 18:17:42.678222 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:17:42.678021    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls podName:b20261f6-ce00-4423-8a9a-eb2e0d60e8e7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:46.678015515 +0000 UTC m=+165.713672142 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls") pod "dns-default-gvw86" (UID: "b20261f6-ce00-4423-8a9a-eb2e0d60e8e7") : secret "dns-default-metrics-tls" not found
Jul 08 18:17:43.048949 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:43.048915    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:43.110209 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:43.110179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:43.163198 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:43.163168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:17:43.746478 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:17:43.746448    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qq524"
Jul 08 18:18:03.824227 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:03.824190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:03.925666 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:03.925618    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:06.201638 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:06.201593    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:07.143945 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.143905    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:07.290620 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.290592    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-57nhm"]
Jul 08 18:18:07.293612 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.293597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.298357 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.298335    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 18:18:07.298357 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.298368    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 18:18:07.298627 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.298611    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 18:18:07.298712 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.298687    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 18:18:07.298810 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.298750    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jvjnk\""
Jul 08 18:18:07.315972 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.315947    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57nhm"]
Jul 08 18:18:07.347010 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.346976    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:07.366212 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.366182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.366380 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.366241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/279f241d-d4c7-476a-a59b-e1b62ffc3b98-crio-socket\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.366380 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.366266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.366489 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.366376    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28bp2\" (UniqueName: \"kubernetes.io/projected/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-api-access-28bp2\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.366489 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.366426    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/279f241d-d4c7-476a-a59b-e1b62ffc3b98-data-volume\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.409083 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.409001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:07.467641 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.467604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/279f241d-d4c7-476a-a59b-e1b62ffc3b98-crio-socket\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.467641 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.467648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.467854 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.467740    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/279f241d-d4c7-476a-a59b-e1b62ffc3b98-crio-socket\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.467854 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:07.467748    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:07.467854 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.467823    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28bp2\" (UniqueName: \"kubernetes.io/projected/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-api-access-28bp2\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.467854 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:07.467839    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.967818065 +0000 UTC m=+127.003474692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:07.468007 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.467880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/279f241d-d4c7-476a-a59b-e1b62ffc3b98-data-volume\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.468007 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.467928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.468079 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:07.468021    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:18:07.468079 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:07.468075    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.968060661 +0000 UTC m=+127.003717300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : configmap "kube-rbac-proxy" not found
Jul 08 18:18:07.468431 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.468414    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/279f241d-d4c7-476a-a59b-e1b62ffc3b98-data-volume\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.479811 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.479785    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28bp2\" (UniqueName: \"kubernetes.io/projected/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-api-access-28bp2\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.973123 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.973078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.973351 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:07.973207    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:07.973351 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:07.973253    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:07.973351 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:07.973334    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:18:07.973477 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:07.973339    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:08.973322294 +0000 UTC m=+128.008978917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:07.973477 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:07.973401    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:08.973388312 +0000 UTC m=+128.009044935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : configmap "kube-rbac-proxy" not found
Jul 08 18:18:08.037970 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.037935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:08.120842 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.120806    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:08.192958 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.192924    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:08.291170 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.291069    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:08.471943 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.471905    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:08.743217 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.743173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:08.847907 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.847876    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:08.981988 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.981943    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:08.982207 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:08.982017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:08.982207 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:08.982068    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:18:08.982207 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:08.982136    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:10.982119906 +0000 UTC m=+130.017776529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : configmap "kube-rbac-proxy" not found
Jul 08 18:18:08.982207 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:08.982196    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:08.982350 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:08.982262    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:10.982250962 +0000 UTC m=+130.017907590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:09.481480 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:09.481453    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hp7x6_ad07d4bb-fdd7-4a94-8d8d-155416ad676c/dns-node-resolver/0.log"
Jul 08 18:18:10.082068 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:10.082038    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pg98t_5be65041-d2a5-4190-ac42-afc16106a8b4/node-ca/0.log"
Jul 08 18:18:10.381829 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:10.381734    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:10.433428 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:10.433389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:10.996316 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:10.996265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:10.996708 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:10.996359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:10.996708 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:10.996395    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:18:10.996708 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:10.996455    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:14.996440358 +0000 UTC m=+134.032096985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : configmap "kube-rbac-proxy" not found
Jul 08 18:18:10.996708 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:10.996509    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:10.996708 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:10.996565    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:14.996551997 +0000 UTC m=+134.032208620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:11.282488 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:11.282397    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v59xd_b90ffd34-ed4c-4158-8256-b2d2c107666e/serve-healthcheck-canary/0.log"
Jul 08 18:18:11.297611 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:11.297587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:18:11.297740 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:11.297726    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 18:18:11.297788 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:11.297780    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs podName:8ac370ef-cd00-4259-8fbd-90e01d361a04 nodeName:}" failed. No retries permitted until 2026-07-08 18:20:13.297767493 +0000 UTC m=+252.333424119 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs") pod "network-metrics-daemon-l27kq" (UID: "8ac370ef-cd00-4259-8fbd-90e01d361a04") : secret "metrics-daemon-secret" not found
Jul 08 18:18:12.510657 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:12.510622    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:14.945745 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:14.945715    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:15.024861 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:15.024828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:15.025044 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:15.024892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:15.025044 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:15.024959    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 18:18:15.025044 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:15.025028    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:23.025010028 +0000 UTC m=+142.060666650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : configmap "kube-rbac-proxy" not found
Jul 08 18:18:15.025178 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:15.025044    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:15.025178 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:15.025104    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:23.025086345 +0000 UTC m=+142.060742975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:15.805134 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:15.805101    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:15.871103 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:15.871068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:16.668925 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:16.668883    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:17.258035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:17.258005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:17.455987 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:17.455934    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:17.860573 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:17.860537    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:18.066307 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:18.066251    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:18.459121 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:18.459089    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:18.985700 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:18.985661    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:19.088107 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:19.088062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:19.186749 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:19.186715    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:19.463760 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:19.463728    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:19.674978 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:19.674940    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:19.760675 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:19.760586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:20.258552 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:20.258513    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:20.522119 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:20.522028    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:20.665142 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:20.665112    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:20.834388 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:20.834302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:20.914285 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:20.914252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:21.261595 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:21.261563    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:21.590467 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:21.590388    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:21.690675 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:21.690642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:22.461447 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:22.461418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:22.669540 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:22.669496    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:23.075620 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:23.075584    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:23.088539 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:23.088515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:23.088620 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:23.088568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:23.088693 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:23.088682    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:23.088754 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:23.088745    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls podName:279f241d-d4c7-476a-a59b-e1b62ffc3b98 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:39.088730507 +0000 UTC m=+158.124387129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nhm" (UID: "279f241d-d4c7-476a-a59b-e1b62ffc3b98") : secret "insights-runtime-extractor-tls" not found
Jul 08 18:18:23.089014 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:23.088999    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/279f241d-d4c7-476a-a59b-e1b62ffc3b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:23.257576 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:23.257539    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:23.665406 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:23.665372    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:24.259939 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:24.259904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:24.668130 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:24.668091    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:24.862820 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:24.862788    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:25.264300 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:25.264267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:25.665809 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:25.665778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:25.870122 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:25.870092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:29.191806 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:29.191750    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:29.285943 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:29.285909    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:31.278013 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:31.277979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:31.378282 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:31.378252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:33.959025 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:33.958988    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:34.062484 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:34.062431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:38.440584 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:38.440549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:38.544362 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:38.544326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:38.604324 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:38.604291    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:38.723336 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:38.723247    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:39.125472 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:39.125379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:39.127664 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:39.127637    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/279f241d-d4c7-476a-a59b-e1b62ffc3b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nhm\" (UID: \"279f241d-d4c7-476a-a59b-e1b62ffc3b98\") " pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:39.306164 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:39.306101    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:39.370137 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:39.370102    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:39.401991 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:39.401965    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57nhm"
Jul 08 18:18:39.524226 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:39.524206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57nhm"]
Jul 08 18:18:39.526716 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:18:39.526690    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279f241d_d4c7_476a_a59b_e1b62ffc3b98.slice/crio-75b67e0b40475f2ecc89b4c5cf7bab89c1dc80c1882b4c0894366fb75843e3ec WatchSource:0}: Error finding container 75b67e0b40475f2ecc89b4c5cf7bab89c1dc80c1882b4c0894366fb75843e3ec: Status 404 returned error can't find the container with id 75b67e0b40475f2ecc89b4c5cf7bab89c1dc80c1882b4c0894366fb75843e3ec
Jul 08 18:18:39.995749 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:39.995717    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57nhm" event={"ID":"279f241d-d4c7-476a-a59b-e1b62ffc3b98","Type":"ContainerStarted","Data":"75b67e0b40475f2ecc89b4c5cf7bab89c1dc80c1882b4c0894366fb75843e3ec"}
Jul 08 18:18:41.634095 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:41.634054    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:41.703968 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:41.703928    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:41.736670 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:41.736632    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr" podUID="8b8da009-2355-4c2c-8df2-8f99897328a2"
Jul 08 18:18:41.752997 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:41.752953    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvw86" podUID="b20261f6-ce00-4423-8a9a-eb2e0d60e8e7"
Jul 08 18:18:41.966860 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:41.966769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:42.002386 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:42.002358    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvw86"
Jul 08 18:18:42.002548 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:42.002358    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:18:43.495265 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:18:43.495185    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l27kq" podUID="8ac370ef-cd00-4259-8fbd-90e01d361a04"
Jul 08 18:18:44.009592 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:44.009555    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57nhm" event={"ID":"279f241d-d4c7-476a-a59b-e1b62ffc3b98","Type":"ContainerStarted","Data":"aaa58eee345cea3aa9354ff9f3c28186181c86b6d8b8cdb052b9ba8aa87fd97e"}
Jul 08 18:18:44.009784 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:44.009614    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57nhm" event={"ID":"279f241d-d4c7-476a-a59b-e1b62ffc3b98","Type":"ContainerStarted","Data":"02efbe0a1ebacdda8e0da53d4c9fa50dca0d8b72912a0751518891a14927daea"}
Jul 08 18:18:45.318737 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:45.318699    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:45.420233 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:45.420196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:45.519993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:45.519960    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:45.620425 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:45.620337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:46.689393 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.689358    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:18:46.689393 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.689397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:18:46.691673 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.691643    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b20261f6-ce00-4423-8a9a-eb2e0d60e8e7-metrics-tls\") pod \"dns-default-gvw86\" (UID: \"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7\") " pod="openshift-dns/dns-default-gvw86"
Jul 08 18:18:46.691810 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.691727    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"image-registry-85d8956cc4-hnczr\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") " pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:18:46.805713 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.805691    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xmj8w\""
Jul 08 18:18:46.806415 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.806396    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d7khc\""
Jul 08 18:18:46.814353 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.814339    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:18:46.814444 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.814426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvw86"
Jul 08 18:18:46.945930 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.945574    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvw86"]
Jul 08 18:18:46.948100 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:18:46.948066    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20261f6_ce00_4423_8a9a_eb2e0d60e8e7.slice/crio-b52b7518c6b51f99775ecd67ae1f68818796d9075978822cb48b80d70a068a04 WatchSource:0}: Error finding container b52b7518c6b51f99775ecd67ae1f68818796d9075978822cb48b80d70a068a04: Status 404 returned error can't find the container with id b52b7518c6b51f99775ecd67ae1f68818796d9075978822cb48b80d70a068a04
Jul 08 18:18:46.965847 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:46.965811    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85d8956cc4-hnczr"]
Jul 08 18:18:46.968470 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:18:46.968440    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8da009_2355_4c2c_8df2_8f99897328a2.slice/crio-daed3220975eec841252546efe50983e937fdd0cdd389482dbe6ab9d63423a6d WatchSource:0}: Error finding container daed3220975eec841252546efe50983e937fdd0cdd389482dbe6ab9d63423a6d: Status 404 returned error can't find the container with id daed3220975eec841252546efe50983e937fdd0cdd389482dbe6ab9d63423a6d
Jul 08 18:18:47.020896 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:47.020865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57nhm" event={"ID":"279f241d-d4c7-476a-a59b-e1b62ffc3b98","Type":"ContainerStarted","Data":"a42c62b019b09fbfd866c1463dcbed2f797fef110817351994a0d6e594b87278"}
Jul 08 18:18:47.022472 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:47.022441    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr" event={"ID":"8b8da009-2355-4c2c-8df2-8f99897328a2","Type":"ContainerStarted","Data":"daed3220975eec841252546efe50983e937fdd0cdd389482dbe6ab9d63423a6d"}
Jul 08 18:18:47.023530 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:47.023511    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvw86" event={"ID":"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7","Type":"ContainerStarted","Data":"b52b7518c6b51f99775ecd67ae1f68818796d9075978822cb48b80d70a068a04"}
Jul 08 18:18:47.039017 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:47.038964    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-57nhm" podStartSLOduration=32.955383869 podStartE2EDuration="40.038946097s" totalImagesPullingTime="7.083562228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:18:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:47.038008422 +0000 UTC m=+166.073665067" watchObservedRunningTime="2026-07-08 18:18:47.038946097 +0000 UTC m=+166.074602741"
Jul 08 18:18:47.760502 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:47.760463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:47.984439 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:47.984405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:48.028623 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.028542    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr" event={"ID":"8b8da009-2355-4c2c-8df2-8f99897328a2","Type":"ContainerStarted","Data":"f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530"}
Jul 08 18:18:48.028775 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.028752    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:18:48.041081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.038498    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tvnt5"]
Jul 08 18:18:48.042799 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.042779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.044985 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.044958    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 18:18:48.045207 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.045187    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gvc99\""
Jul 08 18:18:48.045329 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.045216    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 18:18:48.045329 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.045227    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 18:18:48.045329 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.045267    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 18:18:48.045482 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.045355    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 18:18:48.045593 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.045580    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 18:18:48.059736 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.059682    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr" podStartSLOduration=167.059664875 podStartE2EDuration="2m47.059664875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:48.059312118 +0000 UTC m=+167.094968763" watchObservedRunningTime="2026-07-08 18:18:48.059664875 +0000 UTC m=+167.095321520"
Jul 08 18:18:48.079676 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.079637    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:48.099844 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.099812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.100064 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.100037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-textfile\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.100119 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.100082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wgzw\" (UniqueName: \"kubernetes.io/projected/b9cf4a80-b03d-49a4-9508-aa35eae9257e-kube-api-access-6wgzw\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.100119 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.100117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-sys\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.100251 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.100210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-tls\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.100327 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.100307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-wtmp\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.100385 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.100357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-root\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.100437 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.100397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.100498 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.100481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9cf4a80-b03d-49a4-9508-aa35eae9257e-metrics-client-ca\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.145943 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.145909    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:48.200962 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.200928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-wtmp\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.200962 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.200967    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-root\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.200986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9cf4a80-b03d-49a4-9508-aa35eae9257e-metrics-client-ca\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-textfile\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201089    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wgzw\" (UniqueName: \"kubernetes.io/projected/b9cf4a80-b03d-49a4-9508-aa35eae9257e-kube-api-access-6wgzw\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201044    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-root\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201112    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-wtmp\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-sys\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201230 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201211    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9cf4a80-b03d-49a4-9508-aa35eae9257e-sys\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201691 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-tls\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201691 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201580    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-textfile\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201795 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201777    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.201850 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.201782    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9cf4a80-b03d-49a4-9508-aa35eae9257e-metrics-client-ca\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.203853 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.203831    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-tls\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.203970 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.203874    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9cf4a80-b03d-49a4-9508-aa35eae9257e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.209455 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.209429    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wgzw\" (UniqueName: \"kubernetes.io/projected/b9cf4a80-b03d-49a4-9508-aa35eae9257e-kube-api-access-6wgzw\") pod \"node-exporter-tvnt5\" (UID: \"b9cf4a80-b03d-49a4-9508-aa35eae9257e\") " pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.281431 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.281338    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:48.352213 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.352184    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tvnt5"
Jul 08 18:18:48.363464 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:18:48.363430    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9cf4a80_b03d_49a4_9508_aa35eae9257e.slice/crio-6b2495472db759a301649af3fa19b982b28e7d58fb3960e9243528dd649896eb WatchSource:0}: Error finding container 6b2495472db759a301649af3fa19b982b28e7d58fb3960e9243528dd649896eb: Status 404 returned error can't find the container with id 6b2495472db759a301649af3fa19b982b28e7d58fb3960e9243528dd649896eb
Jul 08 18:18:48.381698 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.381661    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:48.481674 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.481641    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:48.984931 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:48.984860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:49.033885 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:49.033850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvnt5" event={"ID":"b9cf4a80-b03d-49a4-9508-aa35eae9257e","Type":"ContainerStarted","Data":"6b2495472db759a301649af3fa19b982b28e7d58fb3960e9243528dd649896eb"}
Jul 08 18:18:49.077948 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:49.077912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:49.145422 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:49.145386    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:49.287971 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:49.287884    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:49.387324 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:49.387283    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:50.039048 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:50.039015    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvw86" event={"ID":"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7","Type":"ContainerStarted","Data":"fe85d02b6f3b5689663132b68e414808810f720042c08eb0798dc558aaf31f67"}
Jul 08 18:18:50.040647 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:50.040623    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvnt5" event={"ID":"b9cf4a80-b03d-49a4-9508-aa35eae9257e","Type":"ContainerStarted","Data":"c4eead750c4d278555f51ba1062ce280d82fde5f1245f0de539ed65efa267b54"}
Jul 08 18:18:50.975835 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:50.975798    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:51.045167 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.045119    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvw86" event={"ID":"b20261f6-ce00-4423-8a9a-eb2e0d60e8e7","Type":"ContainerStarted","Data":"877c656984a17af16b9324a191ee584258b15a619b1fa31d3c6eb7252241f4db"}
Jul 08 18:18:51.045612 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.045197    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvw86"
Jul 08 18:18:51.046663 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.046641    2558 generic.go:356] "Generic (PLEG): container finished" podID="b9cf4a80-b03d-49a4-9508-aa35eae9257e" containerID="c4eead750c4d278555f51ba1062ce280d82fde5f1245f0de539ed65efa267b54" exitCode=0
Jul 08 18:18:51.046796 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.046679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvnt5" event={"ID":"b9cf4a80-b03d-49a4-9508-aa35eae9257e","Type":"ContainerDied","Data":"c4eead750c4d278555f51ba1062ce280d82fde5f1245f0de539ed65efa267b54"}
Jul 08 18:18:51.067713 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.067665    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gvw86" podStartSLOduration=130.131846189 podStartE2EDuration="2m13.067645608s" totalImagesPullingTime="2.935799419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:51.066369187 +0000 UTC m=+170.102025833" watchObservedRunningTime="2026-07-08 18:18:51.067645608 +0000 UTC m=+170.103302254"
Jul 08 18:18:51.072896 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.072870    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:51.204098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.204066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:51.220143 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.220116    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85d8956cc4-hnczr"]
Jul 08 18:18:51.295191 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.295088    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:51.364807 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.364758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:51.562056 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.561975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:51.651364 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:51.651333    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:52.052045 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:52.052005    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvnt5" event={"ID":"b9cf4a80-b03d-49a4-9508-aa35eae9257e","Type":"ContainerStarted","Data":"f367a1e970608a4879239125b9974d48abefab258b4247e53c508f9cd687e0c0"}
Jul 08 18:18:52.052557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:52.052062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvnt5" event={"ID":"b9cf4a80-b03d-49a4-9508-aa35eae9257e","Type":"ContainerStarted","Data":"768000cec36f5dad7f9f0b186d09ddf1e58a77e75bb5cbe133bef1d3290bd82a"}
Jul 08 18:18:52.072479 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:52.072430    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tvnt5" podStartSLOduration=2.481229885 podStartE2EDuration="4.072414534s" totalImagesPullingTime="1.516337825s" totalInitContainerRuntime="74.846824ms" isStatefulPod=true podCreationTimestamp="2026-07-08 18:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:52.070888622 +0000 UTC m=+171.106545279" watchObservedRunningTime="2026-07-08 18:18:52.072414534 +0000 UTC m=+171.108071179"
Jul 08 18:18:52.782663 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:52.782626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:53.085330 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:53.085242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:54.267457 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:54.267416    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:54.475612 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:54.475580    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:54.624124 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:54.624035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:55.475727 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:55.475692    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:18:56.128631 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:56.128600    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:56.216134 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:56.216103    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:56.316180 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:56.316133    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:56.407469 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:56.407438    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:56.796907 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:56.796793    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:56.846760 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:56.846727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:57.191366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:57.191325    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:57.292863 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:57.292827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:57.408609 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:57.408570    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:57.508992 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:57.508900    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:57.806662 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:57.806547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:57.988861 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:57.988829    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:58.457784 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:58.457757    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:59.605500 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:59.605469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:18:59.655463 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:18:59.655426    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:01.054590 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:01.054556    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvw86"
Jul 08 18:19:07.119529 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:07.119489    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:07.217298 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:07.217229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:07.402971 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:07.402938    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:07.504342 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:07.504305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:10.163992 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:10.163961    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:10.801222 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:10.801192    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:10.903315 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:10.903286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:11.226221 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:11.226194    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:19:11.278522 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:11.278488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:13.812075 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:13.812044    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:13.912521 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:13.912486    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:16.239504 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.239471    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr" podUID="8b8da009-2355-4c2c-8df2-8f99897328a2" containerName="registry" containerID="cri-o://f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530" gracePeriod=30
Jul 08 18:19:16.484759 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.484736    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:19:16.605036 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.604954    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-installation-pull-secrets\") pod \"8b8da009-2355-4c2c-8df2-8f99897328a2\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") "
Jul 08 18:19:16.605036 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.604994    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9kdj\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-kube-api-access-v9kdj\") pod \"8b8da009-2355-4c2c-8df2-8f99897328a2\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") "
Jul 08 18:19:16.605036 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.605017    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-trusted-ca\") pod \"8b8da009-2355-4c2c-8df2-8f99897328a2\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") "
Jul 08 18:19:16.605359 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.605095    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-image-registry-private-configuration\") pod \"8b8da009-2355-4c2c-8df2-8f99897328a2\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") "
Jul 08 18:19:16.605359 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.605180    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") pod \"8b8da009-2355-4c2c-8df2-8f99897328a2\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") "
Jul 08 18:19:16.605359 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.605216    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-certificates\") pod \"8b8da009-2355-4c2c-8df2-8f99897328a2\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") "
Jul 08 18:19:16.605359 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.605249    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b8da009-2355-4c2c-8df2-8f99897328a2-ca-trust-extracted\") pod \"8b8da009-2355-4c2c-8df2-8f99897328a2\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") "
Jul 08 18:19:16.605359 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.605283    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-bound-sa-token\") pod \"8b8da009-2355-4c2c-8df2-8f99897328a2\" (UID: \"8b8da009-2355-4c2c-8df2-8f99897328a2\") "
Jul 08 18:19:16.605626 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.605559    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8b8da009-2355-4c2c-8df2-8f99897328a2" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:19:16.605681 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.605633    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8b8da009-2355-4c2c-8df2-8f99897328a2" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:19:16.607562 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.607531    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-kube-api-access-v9kdj" (OuterVolumeSpecName: "kube-api-access-v9kdj") pod "8b8da009-2355-4c2c-8df2-8f99897328a2" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2"). InnerVolumeSpecName "kube-api-access-v9kdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:19:16.607692 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.607532    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8b8da009-2355-4c2c-8df2-8f99897328a2" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:19:16.607692 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.607619    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8b8da009-2355-4c2c-8df2-8f99897328a2" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:19:16.607794 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.607710    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8b8da009-2355-4c2c-8df2-8f99897328a2" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:19:16.607845 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.607823    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8b8da009-2355-4c2c-8df2-8f99897328a2" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:19:16.613995 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.613971    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8da009-2355-4c2c-8df2-8f99897328a2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8b8da009-2355-4c2c-8df2-8f99897328a2" (UID: "8b8da009-2355-4c2c-8df2-8f99897328a2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:19:16.706602 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.706564    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-installation-pull-secrets\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:19:16.706602 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.706596    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9kdj\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-kube-api-access-v9kdj\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:19:16.706602 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.706605    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-trusted-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:19:16.706815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.706614    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b8da009-2355-4c2c-8df2-8f99897328a2-image-registry-private-configuration\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:19:16.706815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.706624    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:19:16.706815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.706634    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b8da009-2355-4c2c-8df2-8f99897328a2-registry-certificates\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:19:16.706815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.706643    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b8da009-2355-4c2c-8df2-8f99897328a2-ca-trust-extracted\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:19:16.706815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:16.706651    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b8da009-2355-4c2c-8df2-8f99897328a2-bound-sa-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:19:17.135033 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.134995    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b8da009-2355-4c2c-8df2-8f99897328a2" containerID="f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530" exitCode=0
Jul 08 18:19:17.135033 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.135038    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr" event={"ID":"8b8da009-2355-4c2c-8df2-8f99897328a2","Type":"ContainerDied","Data":"f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530"}
Jul 08 18:19:17.135316 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.135059    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr"
Jul 08 18:19:17.135316 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.135118    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d8956cc4-hnczr" event={"ID":"8b8da009-2355-4c2c-8df2-8f99897328a2","Type":"ContainerDied","Data":"daed3220975eec841252546efe50983e937fdd0cdd389482dbe6ab9d63423a6d"}
Jul 08 18:19:17.135316 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.135164    2558 scope.go:117] "RemoveContainer" containerID="f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530"
Jul 08 18:19:17.143057 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.143042    2558 scope.go:117] "RemoveContainer" containerID="f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530"
Jul 08 18:19:17.143388 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:19:17.143356    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530\": container with ID starting with f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530 not found: ID does not exist" containerID="f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530"
Jul 08 18:19:17.143493 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.143397    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530"} err="failed to get container status \"f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530\": rpc error: code = NotFound desc = could not find container \"f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530\": container with ID starting with f5911bf7247c1f27de2d0f732391c55369a915a4dfc9e108a0b624a62750c530 not found: ID does not exist"
Jul 08 18:19:17.158134 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.158109    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85d8956cc4-hnczr"]
Jul 08 18:19:17.160613 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.160593    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85d8956cc4-hnczr"]
Jul 08 18:19:17.479842 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:17.479771    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b8da009-2355-4c2c-8df2-8f99897328a2" path="/var/lib/kubelet/pods/8b8da009-2355-4c2c-8df2-8f99897328a2/volumes"
Jul 08 18:19:18.602080 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:18.602050    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:18.653443 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:18.653410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:18.958588 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:18.958556    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:19.006570 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:19.006531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:19.023912 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:19.023877    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" podUID="cf08d411-e86d-4d76-b0be-c46f5719eeb2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 18:19:21.606542 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:21.606509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:21.661060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:21.661028    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:23.038166 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:23.038122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:23.488162 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:23.488119    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v59xd_b90ffd34-ed4c-4158-8256-b2d2c107666e/serve-healthcheck-canary/0.log"
Jul 08 18:19:24.725347 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:24.725307    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:24.822793 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:24.822761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:24.873923 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:24.873893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:29.024224 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:29.024188    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" podUID="cf08d411-e86d-4d76-b0be-c46f5719eeb2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 18:19:32.824772 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:32.824734    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:32.922735 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:32.922697    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:38.550370 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:38.550331    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:38.628224 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:38.628190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:19:39.024223 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:39.024186    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" podUID="cf08d411-e86d-4d76-b0be-c46f5719eeb2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 18:19:39.024383 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:39.024253    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf"
Jul 08 18:19:39.024723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:39.024705    2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8af46a6665605831f6143066ba278f25a74ed5cf7de60517b6f6927a8c606796"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 08 18:19:39.024759 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:39.024742    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" podUID="cf08d411-e86d-4d76-b0be-c46f5719eeb2" containerName="service-proxy" containerID="cri-o://8af46a6665605831f6143066ba278f25a74ed5cf7de60517b6f6927a8c606796" gracePeriod=30
Jul 08 18:19:39.213572 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:39.213544    2558 generic.go:356] "Generic (PLEG): container finished" podID="cf08d411-e86d-4d76-b0be-c46f5719eeb2" containerID="8af46a6665605831f6143066ba278f25a74ed5cf7de60517b6f6927a8c606796" exitCode=2
Jul 08 18:19:39.213711 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:39.213617    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" event={"ID":"cf08d411-e86d-4d76-b0be-c46f5719eeb2","Type":"ContainerDied","Data":"8af46a6665605831f6143066ba278f25a74ed5cf7de60517b6f6927a8c606796"}
Jul 08 18:19:39.213711 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:19:39.213667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c6b469bf6-bstpf" event={"ID":"cf08d411-e86d-4d76-b0be-c46f5719eeb2","Type":"ContainerStarted","Data":"9074de5861c48bbd7695b3ef763dfb35f00995c4159e7beec89638a0568e01e2"}
Jul 08 18:20:06.968432 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:06.968388    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:07.209425 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:07.209397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:07.741921 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:07.741881    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:13.317026 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:13.316984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:20:13.319207 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:13.319188    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac370ef-cd00-4259-8fbd-90e01d361a04-metrics-certs\") pod \"network-metrics-daemon-l27kq\" (UID: \"8ac370ef-cd00-4259-8fbd-90e01d361a04\") " pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:20:13.478814 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:13.478789    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hn7hw\""
Jul 08 18:20:13.486865 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:13.486850    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l27kq"
Jul 08 18:20:13.605201 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:13.605118    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l27kq"]
Jul 08 18:20:13.608351 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:20:13.608326    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac370ef_cd00_4259_8fbd_90e01d361a04.slice/crio-c3d48761b5780d3a4ce20760b442b91f90644f3c40a7b2b335c47bbc4432429b WatchSource:0}: Error finding container c3d48761b5780d3a4ce20760b442b91f90644f3c40a7b2b335c47bbc4432429b: Status 404 returned error can't find the container with id c3d48761b5780d3a4ce20760b442b91f90644f3c40a7b2b335c47bbc4432429b
Jul 08 18:20:14.329915 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:14.329880    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l27kq" event={"ID":"8ac370ef-cd00-4259-8fbd-90e01d361a04","Type":"ContainerStarted","Data":"c3d48761b5780d3a4ce20760b442b91f90644f3c40a7b2b335c47bbc4432429b"}
Jul 08 18:20:15.336465 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:15.336432    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l27kq" event={"ID":"8ac370ef-cd00-4259-8fbd-90e01d361a04","Type":"ContainerStarted","Data":"1970d2868737bf081314f7f447e94213db2a5a8f45fdc6d60dc1bd04984b5209"}
Jul 08 18:20:15.336848 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:15.336486    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l27kq" event={"ID":"8ac370ef-cd00-4259-8fbd-90e01d361a04","Type":"ContainerStarted","Data":"6f3306653c44fbb720429586bb314768eac4d51df01f206456cdf231be880484"}
Jul 08 18:20:15.351752 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:15.351706    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l27kq" podStartSLOduration=253.269962391 podStartE2EDuration="4m14.351690568s" totalImagesPullingTime="1.081728177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:20:15.350628931 +0000 UTC m=+254.386285575" watchObservedRunningTime="2026-07-08 18:20:15.351690568 +0000 UTC m=+254.387347211"
Jul 08 18:20:15.444803 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:15.444767    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:15.561168 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:15.561127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:16.583722 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:16.583681    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:16.642918 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:16.642883    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:26.122830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:26.122748    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:27.897532 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:27.897490    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:27.998187 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:27.998138    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:28.053453 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:28.053424    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:53.558801 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:53.558756    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:20:53.615513 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:20:53.615484    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:01.397094 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:01.397067    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 18:21:22.439004 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:22.438970    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:22.492514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:22.492482    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:23.855346 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:23.855306    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:23.912718 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:23.912691    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:31.210407 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:31.210369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:34.439528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:34.439495    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:34.502342 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:34.502308    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:35.187272 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:35.187243    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:35.236914 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:35.236868    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:35.292078 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:35.292052    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:48.967246 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:48.967207    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:49.064033 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:49.063998    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:49.118223 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:49.118196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:21:59.691370 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:21:59.691280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:22:43.361974 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:22:43.361941    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:22:44.772942 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:22:44.772888    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:15.149549 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:15.149514    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:15.969235 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:15.969201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:18.758329 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:18.758288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:18.859602 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:18.859557    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:19.863111 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:19.863072    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:20.001358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:20.001325    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:20.820020 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:20.819986    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:20.937488 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:20.937443    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:22.953009 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:22.952976    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:23.369755 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:23.369644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:25.556310 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:25.556268    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:25.627120 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:25.627073    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:28.651412 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:28.651371    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:28.726829 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:28.726789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:30.957248 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:30.957210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:31.648202 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.648173    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rrzdf"]
Jul 08 18:23:31.648396 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.648385    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8da009-2355-4c2c-8df2-8f99897328a2" containerName="registry"
Jul 08 18:23:31.648438 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.648398    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8da009-2355-4c2c-8df2-8f99897328a2" containerName="registry"
Jul 08 18:23:31.648485 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.648448    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b8da009-2355-4c2c-8df2-8f99897328a2" containerName="registry"
Jul 08 18:23:31.651135 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.651121    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rrzdf"
Jul 08 18:23:31.653566 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.653545    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 18:23:31.653683 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.653577    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 18:23:31.654562 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.654542    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2prcj\""
Jul 08 18:23:31.659016 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.658992    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rrzdf"]
Jul 08 18:23:31.710106 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.710087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99a2c93b-252e-4e6f-a3e3-b5cb79d7f021-bound-sa-token\") pod \"cert-manager-55b4d954d5-rrzdf\" (UID: \"99a2c93b-252e-4e6f-a3e3-b5cb79d7f021\") " pod="cert-manager/cert-manager-55b4d954d5-rrzdf"
Jul 08 18:23:31.710231 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.710123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5qwr\" (UniqueName: \"kubernetes.io/projected/99a2c93b-252e-4e6f-a3e3-b5cb79d7f021-kube-api-access-b5qwr\") pod \"cert-manager-55b4d954d5-rrzdf\" (UID: \"99a2c93b-252e-4e6f-a3e3-b5cb79d7f021\") " pod="cert-manager/cert-manager-55b4d954d5-rrzdf"
Jul 08 18:23:31.810883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.810835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99a2c93b-252e-4e6f-a3e3-b5cb79d7f021-bound-sa-token\") pod \"cert-manager-55b4d954d5-rrzdf\" (UID: \"99a2c93b-252e-4e6f-a3e3-b5cb79d7f021\") " pod="cert-manager/cert-manager-55b4d954d5-rrzdf"
Jul 08 18:23:31.811023 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.810897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5qwr\" (UniqueName: \"kubernetes.io/projected/99a2c93b-252e-4e6f-a3e3-b5cb79d7f021-kube-api-access-b5qwr\") pod \"cert-manager-55b4d954d5-rrzdf\" (UID: \"99a2c93b-252e-4e6f-a3e3-b5cb79d7f021\") " pod="cert-manager/cert-manager-55b4d954d5-rrzdf"
Jul 08 18:23:31.818928 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.818898    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99a2c93b-252e-4e6f-a3e3-b5cb79d7f021-bound-sa-token\") pod \"cert-manager-55b4d954d5-rrzdf\" (UID: \"99a2c93b-252e-4e6f-a3e3-b5cb79d7f021\") " pod="cert-manager/cert-manager-55b4d954d5-rrzdf"
Jul 08 18:23:31.819075 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.819056    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5qwr\" (UniqueName: \"kubernetes.io/projected/99a2c93b-252e-4e6f-a3e3-b5cb79d7f021-kube-api-access-b5qwr\") pod \"cert-manager-55b4d954d5-rrzdf\" (UID: \"99a2c93b-252e-4e6f-a3e3-b5cb79d7f021\") " pod="cert-manager/cert-manager-55b4d954d5-rrzdf"
Jul 08 18:23:31.960226 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:31.960143    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rrzdf"
Jul 08 18:23:32.077735 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:32.077707    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rrzdf"]
Jul 08 18:23:32.083784 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:23:32.083756    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99a2c93b_252e_4e6f_a3e3_b5cb79d7f021.slice/crio-93b71614c00594f3bbe329f045edd1fa086f067602dff542964a68b0499508e7 WatchSource:0}: Error finding container 93b71614c00594f3bbe329f045edd1fa086f067602dff542964a68b0499508e7: Status 404 returned error can't find the container with id 93b71614c00594f3bbe329f045edd1fa086f067602dff542964a68b0499508e7
Jul 08 18:23:32.085602 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:32.085584    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:23:32.950369 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:32.950330    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rrzdf" event={"ID":"99a2c93b-252e-4e6f-a3e3-b5cb79d7f021","Type":"ContainerStarted","Data":"93b71614c00594f3bbe329f045edd1fa086f067602dff542964a68b0499508e7"}
Jul 08 18:23:33.025745 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:33.025670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:33.126187 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:33.126131    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:34.393290 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.393256    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"]
Jul 08 18:23:34.396599 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.396583    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"
Jul 08 18:23:34.399060 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.399037    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 18:23:34.400193 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.400062    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-n6vhf\""
Jul 08 18:23:34.400193 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.400120    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 18:23:34.404393 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.404375    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"]
Jul 08 18:23:34.429793 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.429759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/791655eb-c42a-4a26-b152-329a66adca58-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vm85t\" (UID: \"791655eb-c42a-4a26-b152-329a66adca58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"
Jul 08 18:23:34.429942 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.429795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x92rm\" (UniqueName: \"kubernetes.io/projected/791655eb-c42a-4a26-b152-329a66adca58-kube-api-access-x92rm\") pod \"openshift-lws-operator-fd8ccff4c-vm85t\" (UID: \"791655eb-c42a-4a26-b152-329a66adca58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"
Jul 08 18:23:34.530209 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.530174    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/791655eb-c42a-4a26-b152-329a66adca58-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vm85t\" (UID: \"791655eb-c42a-4a26-b152-329a66adca58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"
Jul 08 18:23:34.530367 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.530224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x92rm\" (UniqueName: \"kubernetes.io/projected/791655eb-c42a-4a26-b152-329a66adca58-kube-api-access-x92rm\") pod \"openshift-lws-operator-fd8ccff4c-vm85t\" (UID: \"791655eb-c42a-4a26-b152-329a66adca58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"
Jul 08 18:23:34.530587 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.530565    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/791655eb-c42a-4a26-b152-329a66adca58-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vm85t\" (UID: \"791655eb-c42a-4a26-b152-329a66adca58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"
Jul 08 18:23:34.538074 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.538049    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x92rm\" (UniqueName: \"kubernetes.io/projected/791655eb-c42a-4a26-b152-329a66adca58-kube-api-access-x92rm\") pod \"openshift-lws-operator-fd8ccff4c-vm85t\" (UID: \"791655eb-c42a-4a26-b152-329a66adca58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"
Jul 08 18:23:34.708174 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.708084    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"
Jul 08 18:23:34.897596 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.897567    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t"]
Jul 08 18:23:34.900779 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:23:34.900756    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod791655eb_c42a_4a26_b152_329a66adca58.slice/crio-a58a8310f239dba2267973b74f1fd66a6607c4a0fe8d428a4d05df7a58cbf2a3 WatchSource:0}: Error finding container a58a8310f239dba2267973b74f1fd66a6607c4a0fe8d428a4d05df7a58cbf2a3: Status 404 returned error can't find the container with id a58a8310f239dba2267973b74f1fd66a6607c4a0fe8d428a4d05df7a58cbf2a3
Jul 08 18:23:34.958002 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.957965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t" event={"ID":"791655eb-c42a-4a26-b152-329a66adca58","Type":"ContainerStarted","Data":"a58a8310f239dba2267973b74f1fd66a6607c4a0fe8d428a4d05df7a58cbf2a3"}
Jul 08 18:23:34.959364 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.959303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rrzdf" event={"ID":"99a2c93b-252e-4e6f-a3e3-b5cb79d7f021","Type":"ContainerStarted","Data":"eeccfebf435f0258c40420afc9deeb4bf71e4b7763330479794c1f5480c91ae0"}
Jul 08 18:23:34.976159 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:34.976103    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rrzdf" podStartSLOduration=1.223865433 podStartE2EDuration="3.976091352s" totalImagesPullingTime="2.752225919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:23:34.975734126 +0000 UTC m=+454.011390772" watchObservedRunningTime="2026-07-08 18:23:34.976091352 +0000 UTC m=+454.011747997"
Jul 08 18:23:37.971855 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:37.971822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t" event={"ID":"791655eb-c42a-4a26-b152-329a66adca58","Type":"ContainerStarted","Data":"59ef88f9f9a30e36a14cc758d75ab547c236435100f5ee44106d6dd0b23b4245"}
Jul 08 18:23:37.988101 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:37.988050    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vm85t" podStartSLOduration=1.40695438 podStartE2EDuration="3.988034531s" totalImagesPullingTime="2.581080151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:23:37.986591931 +0000 UTC m=+457.022248576" watchObservedRunningTime="2026-07-08 18:23:37.988034531 +0000 UTC m=+457.023691176"
Jul 08 18:23:38.669330 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:38.669304    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:38.771119 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:38.771082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:40.763464 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:40.763412    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:54.601455 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:54.601410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:54.716959 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:54.716908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:54.986558 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:54.986514    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:55.089788 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.089758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:55.264854 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.264780    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:55.527606 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.527529    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:55.634713 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.634685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:55.675070 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.675041    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"]
Jul 08 18:23:55.677134 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.677116    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.680232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.680212    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 18:23:55.680356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.680240    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 18:23:55.680410 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.680352    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 18:23:55.680459 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.680422    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 18:23:55.680498 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.680481    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vlpxl\""
Jul 08 18:23:55.694358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.694334    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"]
Jul 08 18:23:55.762733 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.762699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfz2v\" (UniqueName: \"kubernetes.io/projected/ebd02d28-0b5d-4121-99a4-7650fc93bf04-kube-api-access-kfz2v\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.762887 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.762739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd02d28-0b5d-4121-99a4-7650fc93bf04-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.762887 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.762762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebd02d28-0b5d-4121-99a4-7650fc93bf04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.762887 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.762780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebd02d28-0b5d-4121-99a4-7650fc93bf04-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.762887 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.762843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd02d28-0b5d-4121-99a4-7650fc93bf04-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.839904 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.839827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:55.864035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.864011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfz2v\" (UniqueName: \"kubernetes.io/projected/ebd02d28-0b5d-4121-99a4-7650fc93bf04-kube-api-access-kfz2v\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.864185 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.864046    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd02d28-0b5d-4121-99a4-7650fc93bf04-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.864185 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.864079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebd02d28-0b5d-4121-99a4-7650fc93bf04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.864185 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.864105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebd02d28-0b5d-4121-99a4-7650fc93bf04-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.864185 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.864138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd02d28-0b5d-4121-99a4-7650fc93bf04-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.864542 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.864515    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebd02d28-0b5d-4121-99a4-7650fc93bf04-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.866339 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.866311    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd02d28-0b5d-4121-99a4-7650fc93bf04-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.866532 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.866517    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd02d28-0b5d-4121-99a4-7650fc93bf04-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.866578 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.866549    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebd02d28-0b5d-4121-99a4-7650fc93bf04-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.872815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.872796    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfz2v\" (UniqueName: \"kubernetes.io/projected/ebd02d28-0b5d-4121-99a4-7650fc93bf04-kube-api-access-kfz2v\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-6lvbf\" (UID: \"ebd02d28-0b5d-4121-99a4-7650fc93bf04\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:55.940350 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.940312    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:55.986783 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:55.986764    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:23:56.059111 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:56.059073    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:56.131390 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:56.131367    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"]
Jul 08 18:23:56.133393 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:23:56.133363    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd02d28_0b5d_4121_99a4_7650fc93bf04.slice/crio-38e62821d9e27848a2e3ae693f61a77cd3ac8dd3afce0de1ce6942f32f35279f WatchSource:0}: Error finding container 38e62821d9e27848a2e3ae693f61a77cd3ac8dd3afce0de1ce6942f32f35279f: Status 404 returned error can't find the container with id 38e62821d9e27848a2e3ae693f61a77cd3ac8dd3afce0de1ce6942f32f35279f
Jul 08 18:23:56.194953 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:56.194917    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:56.295499 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:56.295464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:56.395661 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:56.395627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:23:57.038127 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:23:57.038089    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf" event={"ID":"ebd02d28-0b5d-4121-99a4-7650fc93bf04","Type":"ContainerStarted","Data":"38e62821d9e27848a2e3ae693f61a77cd3ac8dd3afce0de1ce6942f32f35279f"}
Jul 08 18:24:00.050895 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:00.050859    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf" event={"ID":"ebd02d28-0b5d-4121-99a4-7650fc93bf04","Type":"ContainerStarted","Data":"2eb8ff1f8ccdeec5652abf175f7045e6f5f5983eabb8f26624659b33661cd8cf"}
Jul 08 18:24:01.055391 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:01.055357    2558 generic.go:356] "Generic (PLEG): container finished" podID="ebd02d28-0b5d-4121-99a4-7650fc93bf04" containerID="2eb8ff1f8ccdeec5652abf175f7045e6f5f5983eabb8f26624659b33661cd8cf" exitCode=0
Jul 08 18:24:01.055755 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:01.055435    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf" event={"ID":"ebd02d28-0b5d-4121-99a4-7650fc93bf04","Type":"ContainerDied","Data":"2eb8ff1f8ccdeec5652abf175f7045e6f5f5983eabb8f26624659b33661cd8cf"}
Jul 08 18:24:02.061669 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:02.061627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf" event={"ID":"ebd02d28-0b5d-4121-99a4-7650fc93bf04","Type":"ContainerStarted","Data":"3e131c3dde748bc8b2ed90c095d5922de3e66af0954e2990d3ea4c8ecad3d063"}
Jul 08 18:24:02.062059 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:02.061760    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:24:02.083915 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:02.083872    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf" podStartSLOduration=2.600438299 podStartE2EDuration="7.083857864s" totalImagesPullingTime="3.41313441s" totalInitContainerRuntime="1.070285155s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:02.082115571 +0000 UTC m=+481.117772234" watchObservedRunningTime="2026-07-08 18:24:02.083857864 +0000 UTC m=+481.119514508"
Jul 08 18:24:07.617117 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:07.617081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:07.716959 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:07.716903    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:13.066557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:13.066525    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-6lvbf"
Jul 08 18:24:15.255972 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:15.255931    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:15.382170 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:15.382098    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:15.943895 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:15.943861    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vzj22"]
Jul 08 18:24:15.952481 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:15.952451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:15.955050 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:15.955022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 18:24:15.955832 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:15.955807    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wqbq2\""
Jul 08 18:24:15.956197 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:15.956175    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vzj22"]
Jul 08 18:24:15.977801 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:15.977767    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:16.009386 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.009358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wpt6\" (UniqueName: \"kubernetes.io/projected/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-kube-api-access-7wpt6\") pod \"odh-model-controller-7998c67dc4-vzj22\" (UID: \"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6\") " pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:16.009540 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.009391    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-cert\") pod \"odh-model-controller-7998c67dc4-vzj22\" (UID: \"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6\") " pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:16.079295 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.079255    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:16.110186 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.110144    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wpt6\" (UniqueName: \"kubernetes.io/projected/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-kube-api-access-7wpt6\") pod \"odh-model-controller-7998c67dc4-vzj22\" (UID: \"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6\") " pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:16.110367 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.110200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-cert\") pod \"odh-model-controller-7998c67dc4-vzj22\" (UID: \"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6\") " pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:16.110367 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:24:16.110316    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 18:24:16.110489 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:24:16.110377    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-cert podName:652f953b-bfa2-4ab0-a0c6-3e503cdb36c6 nodeName:}" failed. No retries permitted until 2026-07-08 18:24:16.610361486 +0000 UTC m=+495.646018122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-cert") pod "odh-model-controller-7998c67dc4-vzj22" (UID: "652f953b-bfa2-4ab0-a0c6-3e503cdb36c6") : secret "odh-model-controller-webhook-cert" not found
Jul 08 18:24:16.118351 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.118326    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wpt6\" (UniqueName: \"kubernetes.io/projected/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-kube-api-access-7wpt6\") pod \"odh-model-controller-7998c67dc4-vzj22\" (UID: \"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6\") " pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:16.192198 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.192163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:16.358364 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.358272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:16.467200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.467144    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:16.516547 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.516516    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vlvbt"]
Jul 08 18:24:16.519770 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.519750    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:16.522065 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.522042    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 18:24:16.522195 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.522135    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9t22s\""
Jul 08 18:24:16.529758 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.529734    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vlvbt"]
Jul 08 18:24:16.614517 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.614438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-cert\") pod \"odh-model-controller-7998c67dc4-vzj22\" (UID: \"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6\") " pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:16.614517 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.614474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fr8f\" (UniqueName: \"kubernetes.io/projected/c4e57f68-24fc-4dfd-8bc5-f3bf76834da3-kube-api-access-4fr8f\") pod \"model-serving-api-54d89bd5fc-vlvbt\" (UID: \"c4e57f68-24fc-4dfd-8bc5-f3bf76834da3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:16.614517 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.614503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e57f68-24fc-4dfd-8bc5-f3bf76834da3-tls-certs\") pod \"model-serving-api-54d89bd5fc-vlvbt\" (UID: \"c4e57f68-24fc-4dfd-8bc5-f3bf76834da3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:16.616829 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.616800    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/652f953b-bfa2-4ab0-a0c6-3e503cdb36c6-cert\") pod \"odh-model-controller-7998c67dc4-vzj22\" (UID: \"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6\") " pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:16.641565 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.641533    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:16.715741 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.715707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fr8f\" (UniqueName: \"kubernetes.io/projected/c4e57f68-24fc-4dfd-8bc5-f3bf76834da3-kube-api-access-4fr8f\") pod \"model-serving-api-54d89bd5fc-vlvbt\" (UID: \"c4e57f68-24fc-4dfd-8bc5-f3bf76834da3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:16.715898 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.715749    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e57f68-24fc-4dfd-8bc5-f3bf76834da3-tls-certs\") pod \"model-serving-api-54d89bd5fc-vlvbt\" (UID: \"c4e57f68-24fc-4dfd-8bc5-f3bf76834da3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:16.718075 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.718046    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4e57f68-24fc-4dfd-8bc5-f3bf76834da3-tls-certs\") pod \"model-serving-api-54d89bd5fc-vlvbt\" (UID: \"c4e57f68-24fc-4dfd-8bc5-f3bf76834da3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:16.733904 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.733877    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fr8f\" (UniqueName: \"kubernetes.io/projected/c4e57f68-24fc-4dfd-8bc5-f3bf76834da3-kube-api-access-4fr8f\") pod \"model-serving-api-54d89bd5fc-vlvbt\" (UID: \"c4e57f68-24fc-4dfd-8bc5-f3bf76834da3\") " pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:16.830019 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.829984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:16.865823 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.865745    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:16.972751 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:16.972092    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vlvbt"]
Jul 08 18:24:16.976363 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:24:16.975301    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e57f68_24fc_4dfd_8bc5_f3bf76834da3.slice/crio-763366ee70c18a58a1b7826637df40e121cfa53d3bc7347ee11996e13588c6ac WatchSource:0}: Error finding container 763366ee70c18a58a1b7826637df40e121cfa53d3bc7347ee11996e13588c6ac: Status 404 returned error can't find the container with id 763366ee70c18a58a1b7826637df40e121cfa53d3bc7347ee11996e13588c6ac
Jul 08 18:24:17.013513 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:17.013483    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vzj22"]
Jul 08 18:24:17.016428 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:24:17.016402    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652f953b_bfa2_4ab0_a0c6_3e503cdb36c6.slice/crio-9633db3100c25fb68811b864ed2c9630a0bccb63175dd40a303c2936b41ecacb WatchSource:0}: Error finding container 9633db3100c25fb68811b864ed2c9630a0bccb63175dd40a303c2936b41ecacb: Status 404 returned error can't find the container with id 9633db3100c25fb68811b864ed2c9630a0bccb63175dd40a303c2936b41ecacb
Jul 08 18:24:17.117211 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:17.117095    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vzj22" event={"ID":"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6","Type":"ContainerStarted","Data":"9633db3100c25fb68811b864ed2c9630a0bccb63175dd40a303c2936b41ecacb"}
Jul 08 18:24:17.118216 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:17.118182    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt" event={"ID":"c4e57f68-24fc-4dfd-8bc5-f3bf76834da3","Type":"ContainerStarted","Data":"763366ee70c18a58a1b7826637df40e121cfa53d3bc7347ee11996e13588c6ac"}
Jul 08 18:24:21.136414 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:21.136375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vzj22" event={"ID":"652f953b-bfa2-4ab0-a0c6-3e503cdb36c6","Type":"ContainerStarted","Data":"66978a178826a6acb89842323ff4b81bc887f914157e79c79dc4366f1e9a0445"}
Jul 08 18:24:21.136976 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:21.136953    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:21.138241 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:21.138212    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt" event={"ID":"c4e57f68-24fc-4dfd-8bc5-f3bf76834da3","Type":"ContainerStarted","Data":"5879050a0a86a071d49ec6275f50dc1fc5ce451791900d00c4486dcb5e3d0833"}
Jul 08 18:24:21.138367 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:21.138325    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:21.153122 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:21.153059    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vzj22" podStartSLOduration=2.547638676 podStartE2EDuration="6.153040158s" totalImagesPullingTime="3.605401482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:21.152954974 +0000 UTC m=+500.188611621" watchObservedRunningTime="2026-07-08 18:24:21.153040158 +0000 UTC m=+500.188696804"
Jul 08 18:24:21.170284 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:21.170220    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt" podStartSLOduration=1.571972609 podStartE2EDuration="5.170198825s" totalImagesPullingTime="3.598226216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:21.169100459 +0000 UTC m=+500.204757105" watchObservedRunningTime="2026-07-08 18:24:21.170198825 +0000 UTC m=+500.205855473"
Jul 08 18:24:26.237326 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.237257    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:26.314512 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.314460    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57657c797d-9ts86"]
Jul 08 18:24:26.317814 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.317795    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.320175 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.320136    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vcvj4\""
Jul 08 18:24:26.321272 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.321253    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 18:24:26.321272 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.321263    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 18:24:26.321646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.321633    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 18:24:26.323119 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.323103    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 18:24:26.334091 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.334072    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"]
Jul 08 18:24:26.337247 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.337227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:26.338513 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.338493    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57657c797d-9ts86"]
Jul 08 18:24:26.339200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.339182    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xwrwc\""
Jul 08 18:24:26.339816 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.339798    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 08 18:24:26.342015 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.341990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"]
Jul 08 18:24:26.345887 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.345862    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:26.348276 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.348252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:26.349455 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.349435    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-c2w5h\""
Jul 08 18:24:26.349755 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.349743    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 18:24:26.353433 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.353386    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"]
Jul 08 18:24:26.368890 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.368864    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"]
Jul 08 18:24:26.387913 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.387893    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09de7ba4-85b0-43d2-8387-2da9283f594d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sks74\" (UID: \"09de7ba4-85b0-43d2-8387-2da9283f594d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:26.388031 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.387922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d95lv\" (UniqueName: \"kubernetes.io/projected/09de7ba4-85b0-43d2-8387-2da9283f594d-kube-api-access-d95lv\") pod \"llmisvc-controller-manager-777c6bd7d5-sks74\" (UID: \"09de7ba4-85b0-43d2-8387-2da9283f594d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:26.388031 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.387942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54775a2a-d9f0-44f9-9098-74ccdc97a86d-cert\") pod \"kserve-controller-manager-d6f4b65b8-9cw5v\" (UID: \"54775a2a-d9f0-44f9-9098-74ccdc97a86d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:26.388031 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.387974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f94xf\" (UniqueName: \"kubernetes.io/projected/2e177bdb-9738-4620-b8bb-5acbacaab9ec-kube-api-access-f94xf\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.388031 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.387999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwlrq\" (UniqueName: \"kubernetes.io/projected/54775a2a-d9f0-44f9-9098-74ccdc97a86d-kube-api-access-mwlrq\") pod \"kserve-controller-manager-d6f4b65b8-9cw5v\" (UID: \"54775a2a-d9f0-44f9-9098-74ccdc97a86d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:26.388200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.388050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e177bdb-9738-4620-b8bb-5acbacaab9ec-tls-certs\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.388200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.388070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e177bdb-9738-4620-b8bb-5acbacaab9ec-tmp\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.488957 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.488876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f94xf\" (UniqueName: \"kubernetes.io/projected/2e177bdb-9738-4620-b8bb-5acbacaab9ec-kube-api-access-f94xf\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.488957 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.488910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwlrq\" (UniqueName: \"kubernetes.io/projected/54775a2a-d9f0-44f9-9098-74ccdc97a86d-kube-api-access-mwlrq\") pod \"kserve-controller-manager-d6f4b65b8-9cw5v\" (UID: \"54775a2a-d9f0-44f9-9098-74ccdc97a86d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:26.489180 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.488963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e177bdb-9738-4620-b8bb-5acbacaab9ec-tls-certs\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.489180 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.488986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e177bdb-9738-4620-b8bb-5acbacaab9ec-tmp\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.489180 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.489019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09de7ba4-85b0-43d2-8387-2da9283f594d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sks74\" (UID: \"09de7ba4-85b0-43d2-8387-2da9283f594d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:26.489180 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.489049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d95lv\" (UniqueName: \"kubernetes.io/projected/09de7ba4-85b0-43d2-8387-2da9283f594d-kube-api-access-d95lv\") pod \"llmisvc-controller-manager-777c6bd7d5-sks74\" (UID: \"09de7ba4-85b0-43d2-8387-2da9283f594d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:26.489384 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.489198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54775a2a-d9f0-44f9-9098-74ccdc97a86d-cert\") pod \"kserve-controller-manager-d6f4b65b8-9cw5v\" (UID: \"54775a2a-d9f0-44f9-9098-74ccdc97a86d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:26.489384 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:24:26.489344    2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 08 18:24:26.489487 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:24:26.489431    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54775a2a-d9f0-44f9-9098-74ccdc97a86d-cert podName:54775a2a-d9f0-44f9-9098-74ccdc97a86d nodeName:}" failed. No retries permitted until 2026-07-08 18:24:26.989408481 +0000 UTC m=+506.025065106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/54775a2a-d9f0-44f9-9098-74ccdc97a86d-cert") pod "kserve-controller-manager-d6f4b65b8-9cw5v" (UID: "54775a2a-d9f0-44f9-9098-74ccdc97a86d") : secret "kserve-webhook-server-cert" not found
Jul 08 18:24:26.491273 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.491245    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e177bdb-9738-4620-b8bb-5acbacaab9ec-tmp\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.491480 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.491462    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e177bdb-9738-4620-b8bb-5acbacaab9ec-tls-certs\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.491543 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.491495    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09de7ba4-85b0-43d2-8387-2da9283f594d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sks74\" (UID: \"09de7ba4-85b0-43d2-8387-2da9283f594d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:26.505334 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.505312    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d95lv\" (UniqueName: \"kubernetes.io/projected/09de7ba4-85b0-43d2-8387-2da9283f594d-kube-api-access-d95lv\") pod \"llmisvc-controller-manager-777c6bd7d5-sks74\" (UID: \"09de7ba4-85b0-43d2-8387-2da9283f594d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:26.506700 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.506679    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f94xf\" (UniqueName: \"kubernetes.io/projected/2e177bdb-9738-4620-b8bb-5acbacaab9ec-kube-api-access-f94xf\") pod \"kube-auth-proxy-57657c797d-9ts86\" (UID: \"2e177bdb-9738-4620-b8bb-5acbacaab9ec\") " pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.513946 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.513921    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwlrq\" (UniqueName: \"kubernetes.io/projected/54775a2a-d9f0-44f9-9098-74ccdc97a86d-kube-api-access-mwlrq\") pod \"kserve-controller-manager-d6f4b65b8-9cw5v\" (UID: \"54775a2a-d9f0-44f9-9098-74ccdc97a86d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:26.518967 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.518912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:26.623202 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.623139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:26.627881 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.627864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86"
Jul 08 18:24:26.657842 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.657810    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:26.778532 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.778503    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57657c797d-9ts86"]
Jul 08 18:24:26.781561 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:24:26.781528    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e177bdb_9738_4620_b8bb_5acbacaab9ec.slice/crio-446b1913908b71364e94f76668d83758f4d2e340ed4f9a9d43591c0202a95bc4 WatchSource:0}: Error finding container 446b1913908b71364e94f76668d83758f4d2e340ed4f9a9d43591c0202a95bc4: Status 404 returned error can't find the container with id 446b1913908b71364e94f76668d83758f4d2e340ed4f9a9d43591c0202a95bc4
Jul 08 18:24:26.820718 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.820694    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"]
Jul 08 18:24:26.822840 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:24:26.822812    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod09de7ba4_85b0_43d2_8387_2da9283f594d.slice/crio-893145fd4575be539280aa07dc322bfdda4cac8ea609e63324ae5c5ed9611f98 WatchSource:0}: Error finding container 893145fd4575be539280aa07dc322bfdda4cac8ea609e63324ae5c5ed9611f98: Status 404 returned error can't find the container with id 893145fd4575be539280aa07dc322bfdda4cac8ea609e63324ae5c5ed9611f98
Jul 08 18:24:26.994172 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.994115    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54775a2a-d9f0-44f9-9098-74ccdc97a86d-cert\") pod \"kserve-controller-manager-d6f4b65b8-9cw5v\" (UID: \"54775a2a-d9f0-44f9-9098-74ccdc97a86d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:26.996466 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:26.996444    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54775a2a-d9f0-44f9-9098-74ccdc97a86d-cert\") pod \"kserve-controller-manager-d6f4b65b8-9cw5v\" (UID: \"54775a2a-d9f0-44f9-9098-74ccdc97a86d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:27.160274 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:27.160237    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74" event={"ID":"09de7ba4-85b0-43d2-8387-2da9283f594d","Type":"ContainerStarted","Data":"893145fd4575be539280aa07dc322bfdda4cac8ea609e63324ae5c5ed9611f98"}
Jul 08 18:24:27.161213 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:27.161186    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86" event={"ID":"2e177bdb-9738-4620-b8bb-5acbacaab9ec","Type":"ContainerStarted","Data":"446b1913908b71364e94f76668d83758f4d2e340ed4f9a9d43591c0202a95bc4"}
Jul 08 18:24:27.248791 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:27.248752    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:27.383202 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:27.383176    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"]
Jul 08 18:24:27.385411 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:24:27.385386    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54775a2a_d9f0_44f9_9098_74ccdc97a86d.slice/crio-4a5d25bf5b296456f1a82ee3abe23883e44fc715657ef68b6952034160e28a6e WatchSource:0}: Error finding container 4a5d25bf5b296456f1a82ee3abe23883e44fc715657ef68b6952034160e28a6e: Status 404 returned error can't find the container with id 4a5d25bf5b296456f1a82ee3abe23883e44fc715657ef68b6952034160e28a6e
Jul 08 18:24:27.567080 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:27.566991    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:27.744768 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:27.744697    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:27.888836 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:27.888776    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:28.168074 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.167961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v" event={"ID":"54775a2a-d9f0-44f9-9098-74ccdc97a86d","Type":"ContainerStarted","Data":"4a5d25bf5b296456f1a82ee3abe23883e44fc715657ef68b6952034160e28a6e"}
Jul 08 18:24:28.720625 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.720510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:28.723119 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.723081    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"]
Jul 08 18:24:28.726613 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.726572    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.729389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.729324    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 18:24:28.729505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.729476    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w8cs2\""
Jul 08 18:24:28.729704 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.729684    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 18:24:28.730947 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.730925    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 18:24:28.731095 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.731076    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 18:24:28.746334 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.746303    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"]
Jul 08 18:24:28.810854 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.810824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.811035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.810864    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.811035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.810889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.811035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.810949    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.811200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.811056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.811200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.811085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjc7k\" (UniqueName: \"kubernetes.io/projected/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-kube-api-access-wjc7k\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.811200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.811133    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.874030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.873993    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:28.911949 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.911918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.912106 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.911973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.912106 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.912000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjc7k\" (UniqueName: \"kubernetes.io/projected/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-kube-api-access-wjc7k\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.912106 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.912031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.912106 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.912070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.912361 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.912108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.912361 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.912140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.913039 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.913016    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.914716 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.914690    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.914887 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.914864    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.914931 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.914918    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.915023 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.915002    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.926803 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.926756    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:28.927123 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:28.927099    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjc7k\" (UniqueName: \"kubernetes.io/projected/9a219446-a2ff-49dd-bd65-ea04ea6d4ab7-kube-api-access-wjc7k\") pod \"istiod-openshift-gateway-94bb8fbfd-6p9rk\" (UID: \"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:29.038525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:29.038451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:29.180010 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:29.179962    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"]
Jul 08 18:24:29.182909 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:24:29.182881    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a219446_a2ff_49dd_bd65_ea04ea6d4ab7.slice/crio-ac38988876af875b04be0ef5325a5bcbb7a4b150c72b82161c4cf7f366ee45b0 WatchSource:0}: Error finding container ac38988876af875b04be0ef5325a5bcbb7a4b150c72b82161c4cf7f366ee45b0: Status 404 returned error can't find the container with id ac38988876af875b04be0ef5325a5bcbb7a4b150c72b82161c4cf7f366ee45b0
Jul 08 18:24:30.064828 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:30.064784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:30.178307 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:30.178272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk" event={"ID":"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7","Type":"ContainerStarted","Data":"ac38988876af875b04be0ef5325a5bcbb7a4b150c72b82161c4cf7f366ee45b0"}
Jul 08 18:24:32.150663 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.150631    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vlvbt"
Jul 08 18:24:32.193869 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.193833    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74" event={"ID":"09de7ba4-85b0-43d2-8387-2da9283f594d","Type":"ContainerStarted","Data":"5d74e381ef23f736cb348b54f5c22f168cffc43f833e7b8d4060a1eb6dae46bc"}
Jul 08 18:24:32.194036 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.193939    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:24:32.195518 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.195492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v" event={"ID":"54775a2a-d9f0-44f9-9098-74ccdc97a86d","Type":"ContainerStarted","Data":"dfbdcf61c5329e0fda9b5cc40063728fca606b90daaa11f5d8391685451c4207"}
Jul 08 18:24:32.195644 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.195577    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:24:32.197201 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.197177    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86" event={"ID":"2e177bdb-9738-4620-b8bb-5acbacaab9ec","Type":"ContainerStarted","Data":"2ec3af75784633f8ec917d624b3fee3566cfd484e8a0a4f482f9bb47c1233f46"}
Jul 08 18:24:32.209726 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.209683    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74" podStartSLOduration=1.493201734 podStartE2EDuration="6.20966994s" totalImagesPullingTime="4.716468206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:32.209118118 +0000 UTC m=+511.244774762" watchObservedRunningTime="2026-07-08 18:24:32.20966994 +0000 UTC m=+511.245326585"
Jul 08 18:24:32.225090 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.225043    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57657c797d-9ts86" podStartSLOduration=1.4768547920000001 podStartE2EDuration="6.225025102s" totalImagesPullingTime="4.74817031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:32.223428181 +0000 UTC m=+511.259084828" watchObservedRunningTime="2026-07-08 18:24:32.225025102 +0000 UTC m=+511.260681749"
Jul 08 18:24:32.239024 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:32.238976    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v" podStartSLOduration=2.083604528 podStartE2EDuration="6.23896426s" totalImagesPullingTime="4.155359732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:32.237426354 +0000 UTC m=+511.273083012" watchObservedRunningTime="2026-07-08 18:24:32.23896426 +0000 UTC m=+511.274620907"
Jul 08 18:24:33.147759 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:33.147721    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vzj22"
Jul 08 18:24:36.812377 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:36.812339    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:24:36.812778 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:36.812421    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:24:37.220226 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:37.220187    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk" event={"ID":"9a219446-a2ff-49dd-bd65-ea04ea6d4ab7","Type":"ContainerStarted","Data":"2cd37feffdc7d0f9bd9e66b8d4fc031c57096d120695995a0aac1126b1bbe5e2"}
Jul 08 18:24:37.220420 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:37.220276    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:24:37.221910 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:37.221881    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-6p9rk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 18:24:37.222042 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:37.221937    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk" podUID="9a219446-a2ff-49dd-bd65-ea04ea6d4ab7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 18:24:37.239549 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:37.239493    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk" podStartSLOduration=1.613079653 podStartE2EDuration="9.239474927s" totalImagesPullingTime="7.626395274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:37.238051105 +0000 UTC m=+516.273707777" watchObservedRunningTime="2026-07-08 18:24:37.239474927 +0000 UTC m=+516.275131574"
Jul 08 18:24:37.774215 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:37.774157    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:37.874087 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:37.874051    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:38.064189 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:38.064076    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:38.216672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:38.216629    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:38.225234 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:38.225199    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-6p9rk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 18:24:38.225415 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:38.225266    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk" podUID="9a219446-a2ff-49dd-bd65-ea04ea6d4ab7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 18:24:38.472983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:38.472951    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:24:41.225431 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:24:41.225403    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6p9rk"
Jul 08 18:25:03.204197 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:03.204091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sks74"
Jul 08 18:25:03.207028 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:03.207011    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9cw5v"
Jul 08 18:25:16.711822 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:16.711752    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:16.847971 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:16.847935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:16.916026 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:16.915993    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:18.454240 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:18.454204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:18.517866 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:18.517823    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:18.849080 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:18.848975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:18.947123 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:18.947086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:29.349615 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:29.349574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:29.453896 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:29.453861    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:29.551303 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:29.551270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:39.182469 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:39.182430    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:39.239286 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:39.239254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:39.290502 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:39.290467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:45.518433 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:45.518389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:48.922184 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:48.922107    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:49.714581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:49.714543    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:53.043454 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:53.043415    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:53.141773 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:53.141736    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:53.370938 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:53.370850    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:54.946755 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:54.946709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:55.522742 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.522710    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"]
Jul 08 18:25:55.525957 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.525935    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"
Jul 08 18:25:55.528625 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.528606    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 18:25:55.528960 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.528940    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pvf5h\""
Jul 08 18:25:55.530257 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.530242    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 18:25:55.530345 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.530314    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 18:25:55.544284 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.544261    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"]
Jul 08 18:25:55.568265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.568232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pxmd\" (UniqueName: \"kubernetes.io/projected/ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7-kube-api-access-6pxmd\") pod \"dns-operator-controller-manager-864dd78c4c-b7hjf\" (UID: \"ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"
Jul 08 18:25:55.669286 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.669251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pxmd\" (UniqueName: \"kubernetes.io/projected/ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7-kube-api-access-6pxmd\") pod \"dns-operator-controller-manager-864dd78c4c-b7hjf\" (UID: \"ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"
Jul 08 18:25:55.678511 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.678485    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pxmd\" (UniqueName: \"kubernetes.io/projected/ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7-kube-api-access-6pxmd\") pod \"dns-operator-controller-manager-864dd78c4c-b7hjf\" (UID: \"ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"
Jul 08 18:25:55.837087 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.836998    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"
Jul 08 18:25:55.963653 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:55.963623    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"]
Jul 08 18:25:55.967091 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:25:55.967066    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6fbcf4_1b44_4b03_92c4_8d32c8ab5bc7.slice/crio-c5af2f27ab0e4590f7916fd70fc84cba5fc27a7dbc61525c7d62dd0343ff40a3 WatchSource:0}: Error finding container c5af2f27ab0e4590f7916fd70fc84cba5fc27a7dbc61525c7d62dd0343ff40a3: Status 404 returned error can't find the container with id c5af2f27ab0e4590f7916fd70fc84cba5fc27a7dbc61525c7d62dd0343ff40a3
Jul 08 18:25:56.124423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:56.124334    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:56.235952 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:56.235915    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:56.541465 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:56.541429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf" event={"ID":"ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7","Type":"ContainerStarted","Data":"c5af2f27ab0e4590f7916fd70fc84cba5fc27a7dbc61525c7d62dd0343ff40a3"}
Jul 08 18:25:56.656244 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:56.656206    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:57.969510 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:57.969479    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:25:59.554682 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:59.554647    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf" event={"ID":"ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7","Type":"ContainerStarted","Data":"c74b7f9dbcdd52e3730fc0b80103953df4ba12beae4680609397ebf6abc5064e"}
Jul 08 18:25:59.555085 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:59.554726    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"
Jul 08 18:25:59.572139 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:25:59.572086    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf" podStartSLOduration=2.043425433 podStartE2EDuration="4.572070808s" totalImagesPullingTime="2.528645375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:25:59.570644265 +0000 UTC m=+598.606300920" watchObservedRunningTime="2026-07-08 18:25:59.572070808 +0000 UTC m=+598.607727450"
Jul 08 18:26:01.141245 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:01.141208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:01.244939 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:01.244896    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:06.526557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:06.526516    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:06.636191 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:06.636132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:06.957474 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:06.957432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:07.059422 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:07.059391    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:09.929751 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:09.929709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:10.028505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:10.028472    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:10.368051 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:10.367963    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:10.502867 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:10.502834    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:10.561577 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:10.561542    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b7hjf"
Jul 08 18:26:14.068451 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:14.068412    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:14.175486 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:14.175450    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:20.321243 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.321207    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"]
Jul 08 18:26:20.324373 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.324356    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:20.326874 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.326851    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gh9kx\""
Jul 08 18:26:20.339039 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.339011    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"]
Jul 08 18:26:20.478297 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.478261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzh9h\" (UniqueName: \"kubernetes.io/projected/46765f33-6c5c-4f2f-915d-283033f0176a-kube-api-access-dzh9h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ct2zx\" (UID: \"46765f33-6c5c-4f2f-915d-283033f0176a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:20.478297 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.478298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46765f33-6c5c-4f2f-915d-283033f0176a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ct2zx\" (UID: \"46765f33-6c5c-4f2f-915d-283033f0176a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:20.579365 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.579275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46765f33-6c5c-4f2f-915d-283033f0176a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ct2zx\" (UID: \"46765f33-6c5c-4f2f-915d-283033f0176a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:20.579515 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.579487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzh9h\" (UniqueName: \"kubernetes.io/projected/46765f33-6c5c-4f2f-915d-283033f0176a-kube-api-access-dzh9h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ct2zx\" (UID: \"46765f33-6c5c-4f2f-915d-283033f0176a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:20.579740 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.579712    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46765f33-6c5c-4f2f-915d-283033f0176a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ct2zx\" (UID: \"46765f33-6c5c-4f2f-915d-283033f0176a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:20.589326 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.589301    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzh9h\" (UniqueName: \"kubernetes.io/projected/46765f33-6c5c-4f2f-915d-283033f0176a-kube-api-access-dzh9h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ct2zx\" (UID: \"46765f33-6c5c-4f2f-915d-283033f0176a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:20.634471 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.634435    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:20.742618 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.742566    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:20.769665 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.769526    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"]
Jul 08 18:26:20.772400 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:26:20.772359    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46765f33_6c5c_4f2f_915d_283033f0176a.slice/crio-361f971caa76b30e5e295882dbdc62b7dbbacb56026265d4695f78a32b884bf1 WatchSource:0}: Error finding container 361f971caa76b30e5e295882dbdc62b7dbbacb56026265d4695f78a32b884bf1: Status 404 returned error can't find the container with id 361f971caa76b30e5e295882dbdc62b7dbbacb56026265d4695f78a32b884bf1
Jul 08 18:26:20.840822 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.840739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:20.952648 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.952613    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"]
Jul 08 18:26:20.957300 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.957274    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"]
Jul 08 18:26:20.974409 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.974367    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"]
Jul 08 18:26:20.979098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.979074    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:20.991715 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:20.991693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"]
Jul 08 18:26:21.084241 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.084203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xnw\" (UniqueName: \"kubernetes.io/projected/e57f8472-1e6f-4e61-ab5b-439144ee084a-kube-api-access-42xnw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-dwlmw\" (UID: \"e57f8472-1e6f-4e61-ab5b-439144ee084a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:21.084403 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.084327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57f8472-1e6f-4e61-ab5b-439144ee084a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-dwlmw\" (UID: \"e57f8472-1e6f-4e61-ab5b-439144ee084a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:21.185557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.185521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57f8472-1e6f-4e61-ab5b-439144ee084a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-dwlmw\" (UID: \"e57f8472-1e6f-4e61-ab5b-439144ee084a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:21.185735 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.185602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42xnw\" (UniqueName: \"kubernetes.io/projected/e57f8472-1e6f-4e61-ab5b-439144ee084a-kube-api-access-42xnw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-dwlmw\" (UID: \"e57f8472-1e6f-4e61-ab5b-439144ee084a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:21.185889 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.185870    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57f8472-1e6f-4e61-ab5b-439144ee084a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-dwlmw\" (UID: \"e57f8472-1e6f-4e61-ab5b-439144ee084a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:21.197225 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.197194    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xnw\" (UniqueName: \"kubernetes.io/projected/e57f8472-1e6f-4e61-ab5b-439144ee084a-kube-api-access-42xnw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-dwlmw\" (UID: \"e57f8472-1e6f-4e61-ab5b-439144ee084a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:21.290127 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.290088    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:21.468803 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.468780    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"]
Jul 08 18:26:21.555797 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:26:21.555756    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57f8472_1e6f_4e61_ab5b_439144ee084a.slice/crio-ea93e82dd02bba09dacf8580cfbe10a1d3b810611aae89f8c3e76c6e1c348c31 WatchSource:0}: Error finding container ea93e82dd02bba09dacf8580cfbe10a1d3b810611aae89f8c3e76c6e1c348c31: Status 404 returned error can't find the container with id ea93e82dd02bba09dacf8580cfbe10a1d3b810611aae89f8c3e76c6e1c348c31
Jul 08 18:26:21.644703 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:21.644665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw" event={"ID":"e57f8472-1e6f-4e61-ab5b-439144ee084a","Type":"ContainerStarted","Data":"ea93e82dd02bba09dacf8580cfbe10a1d3b810611aae89f8c3e76c6e1c348c31"}
Jul 08 18:26:24.494471 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:24.494375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:24.555217 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:24.555176    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:24.697618 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:24.697581    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:24.800397 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:24.800302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:26.671098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:26.671062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw" event={"ID":"e57f8472-1e6f-4e61-ab5b-439144ee084a","Type":"ContainerStarted","Data":"227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969"}
Jul 08 18:26:26.671568 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:26.671196    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:26.672661 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:26.672636    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx" podUID="46765f33-6c5c-4f2f-915d-283033f0176a" containerName="manager" containerID="cri-o://0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8" gracePeriod=2
Jul 08 18:26:26.688999 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:26.688945    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw" podStartSLOduration=2.495590926 podStartE2EDuration="6.688924828s" totalImagesPullingTime="4.193333902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:26:26.688029068 +0000 UTC m=+625.723685726" watchObservedRunningTime="2026-07-08 18:26:26.688924828 +0000 UTC m=+625.724581469"
Jul 08 18:26:26.905722 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:26.905698    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:26.908182 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:26:26.908130    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ct2zx\" is forbidden: User \"system:node:ip-10-0-138-160.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-160.ec2.internal' and this object" podUID="46765f33-6c5c-4f2f-915d-283033f0176a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:27.034285 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.034202    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzh9h\" (UniqueName: \"kubernetes.io/projected/46765f33-6c5c-4f2f-915d-283033f0176a-kube-api-access-dzh9h\") pod \"46765f33-6c5c-4f2f-915d-283033f0176a\" (UID: \"46765f33-6c5c-4f2f-915d-283033f0176a\") "
Jul 08 18:26:27.034426 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.034301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46765f33-6c5c-4f2f-915d-283033f0176a-extensions-socket-volume\") pod \"46765f33-6c5c-4f2f-915d-283033f0176a\" (UID: \"46765f33-6c5c-4f2f-915d-283033f0176a\") "
Jul 08 18:26:27.034559 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.034534    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46765f33-6c5c-4f2f-915d-283033f0176a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46765f33-6c5c-4f2f-915d-283033f0176a" (UID: "46765f33-6c5c-4f2f-915d-283033f0176a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:26:27.036368 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.036349    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46765f33-6c5c-4f2f-915d-283033f0176a-kube-api-access-dzh9h" (OuterVolumeSpecName: "kube-api-access-dzh9h") pod "46765f33-6c5c-4f2f-915d-283033f0176a" (UID: "46765f33-6c5c-4f2f-915d-283033f0176a"). InnerVolumeSpecName "kube-api-access-dzh9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:26:27.135196 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.135140    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzh9h\" (UniqueName: \"kubernetes.io/projected/46765f33-6c5c-4f2f-915d-283033f0176a-kube-api-access-dzh9h\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:26:27.135196 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.135191    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46765f33-6c5c-4f2f-915d-283033f0176a-extensions-socket-volume\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:26:27.481203 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.481172    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46765f33-6c5c-4f2f-915d-283033f0176a" path="/var/lib/kubelet/pods/46765f33-6c5c-4f2f-915d-283033f0176a/volumes"
Jul 08 18:26:27.678000 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.677969    2558 generic.go:356] "Generic (PLEG): container finished" podID="46765f33-6c5c-4f2f-915d-283033f0176a" containerID="0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8" exitCode=2
Jul 08 18:26:27.678480 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.678011    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:27.678480 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.678067    2558 scope.go:117] "RemoveContainer" containerID="0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8"
Jul 08 18:26:27.682593 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:26:27.682567    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ct2zx\" is forbidden: User \"system:node:ip-10-0-138-160.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-160.ec2.internal' and this object" podUID="46765f33-6c5c-4f2f-915d-283033f0176a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ct2zx"
Jul 08 18:26:27.686165 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.686138    2558 scope.go:117] "RemoveContainer" containerID="0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8"
Jul 08 18:26:27.686414 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:26:27.686388    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8\": container with ID starting with 0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8 not found: ID does not exist" containerID="0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8"
Jul 08 18:26:27.686503 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:27.686422    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8"} err="failed to get container status \"0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8\": rpc error: code = NotFound desc = could not find container \"0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8\": container with ID starting with 0a11c459b6c141db1ee47891d06ded55b9e39459417c993fa95fde40f0e139b8 not found: ID does not exist"
Jul 08 18:26:28.506354 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:28.506309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:28.572947 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:28.572912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:34.706014 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:34.705977    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:34.806514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:34.806474    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:37.680440 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:37.680407    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:50.457854 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.457819    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"]
Jul 08 18:26:50.458454 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.458069    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw" podUID="e57f8472-1e6f-4e61-ab5b-439144ee084a" containerName="manager" containerID="cri-o://227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969" gracePeriod=10
Jul 08 18:26:50.705380 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.705357    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:50.771847 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.771757    2558 generic.go:356] "Generic (PLEG): container finished" podID="e57f8472-1e6f-4e61-ab5b-439144ee084a" containerID="227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969" exitCode=0
Jul 08 18:26:50.771847 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.771803    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"
Jul 08 18:26:50.772035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.771844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw" event={"ID":"e57f8472-1e6f-4e61-ab5b-439144ee084a","Type":"ContainerDied","Data":"227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969"}
Jul 08 18:26:50.772035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.771899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw" event={"ID":"e57f8472-1e6f-4e61-ab5b-439144ee084a","Type":"ContainerDied","Data":"ea93e82dd02bba09dacf8580cfbe10a1d3b810611aae89f8c3e76c6e1c348c31"}
Jul 08 18:26:50.772035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.771926    2558 scope.go:117] "RemoveContainer" containerID="227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969"
Jul 08 18:26:50.779739 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.779721    2558 scope.go:117] "RemoveContainer" containerID="227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969"
Jul 08 18:26:50.779987 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:26:50.779971    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969\": container with ID starting with 227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969 not found: ID does not exist" containerID="227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969"
Jul 08 18:26:50.780036 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.780003    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969"} err="failed to get container status \"227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969\": rpc error: code = NotFound desc = could not find container \"227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969\": container with ID starting with 227fc81257f3df076c329f170197b306685c32563a3d9e3993feeb89b5428969 not found: ID does not exist"
Jul 08 18:26:50.830906 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.830875    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57f8472-1e6f-4e61-ab5b-439144ee084a-extensions-socket-volume\") pod \"e57f8472-1e6f-4e61-ab5b-439144ee084a\" (UID: \"e57f8472-1e6f-4e61-ab5b-439144ee084a\") "
Jul 08 18:26:50.831070 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.830914    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42xnw\" (UniqueName: \"kubernetes.io/projected/e57f8472-1e6f-4e61-ab5b-439144ee084a-kube-api-access-42xnw\") pod \"e57f8472-1e6f-4e61-ab5b-439144ee084a\" (UID: \"e57f8472-1e6f-4e61-ab5b-439144ee084a\") "
Jul 08 18:26:50.831438 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.831403    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57f8472-1e6f-4e61-ab5b-439144ee084a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e57f8472-1e6f-4e61-ab5b-439144ee084a" (UID: "e57f8472-1e6f-4e61-ab5b-439144ee084a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:26:50.832922 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.832898    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57f8472-1e6f-4e61-ab5b-439144ee084a-kube-api-access-42xnw" (OuterVolumeSpecName: "kube-api-access-42xnw") pod "e57f8472-1e6f-4e61-ab5b-439144ee084a" (UID: "e57f8472-1e6f-4e61-ab5b-439144ee084a"). InnerVolumeSpecName "kube-api-access-42xnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:26:50.932265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.932217    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57f8472-1e6f-4e61-ab5b-439144ee084a-extensions-socket-volume\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:26:50.932265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:50.932253    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42xnw\" (UniqueName: \"kubernetes.io/projected/e57f8472-1e6f-4e61-ab5b-439144ee084a-kube-api-access-42xnw\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:26:51.095495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:51.095460    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"]
Jul 08 18:26:51.099497 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:51.099473    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-dwlmw"]
Jul 08 18:26:51.481107 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:51.481073    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57f8472-1e6f-4e61-ab5b-439144ee084a" path="/var/lib/kubelet/pods/e57f8472-1e6f-4e61-ab5b-439144ee084a/volumes"
Jul 08 18:26:54.047863 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.047827    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"]
Jul 08 18:26:54.048250 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.048232    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46765f33-6c5c-4f2f-915d-283033f0176a" containerName="manager"
Jul 08 18:26:54.048294 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.048253    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="46765f33-6c5c-4f2f-915d-283033f0176a" containerName="manager"
Jul 08 18:26:54.048294 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.048265    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57f8472-1e6f-4e61-ab5b-439144ee084a" containerName="manager"
Jul 08 18:26:54.048294 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.048274    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57f8472-1e6f-4e61-ab5b-439144ee084a" containerName="manager"
Jul 08 18:26:54.048385 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.048365    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="46765f33-6c5c-4f2f-915d-283033f0176a" containerName="manager"
Jul 08 18:26:54.048385 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.048377    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57f8472-1e6f-4e61-ab5b-439144ee084a" containerName="manager"
Jul 08 18:26:54.054738 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.054722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.057000 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.056984    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qm2nm\""
Jul 08 18:26:54.063479 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.063455    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"]
Jul 08 18:26:54.084381 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.084352    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:54.156104 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.156274 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.156274 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.156274 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.156426 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.156426 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.156426 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.156426 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppnr6\" (UniqueName: \"kubernetes.io/projected/cc044107-9fe4-47a2-9bf5-4411b79bb4db-kube-api-access-ppnr6\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.156426 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.156408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.256772 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.256738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.256954 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.256781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.256954 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.256796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.256954 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.256912    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257119 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.256961    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppnr6\" (UniqueName: \"kubernetes.io/projected/cc044107-9fe4-47a2-9bf5-4411b79bb4db-kube-api-access-ppnr6\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257197 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.257143    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257253 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.257175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257253 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.257246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.257275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.257247    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.257314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257492 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.257468    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.257610 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.257592    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.258074 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.258053    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.259202 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.259181    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.259644 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.259624    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.264818 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.264792    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppnr6\" (UniqueName: \"kubernetes.io/projected/cc044107-9fe4-47a2-9bf5-4411b79bb4db-kube-api-access-ppnr6\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.264905 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.264822    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc044107-9fe4-47a2-9bf5-4411b79bb4db-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9hwdn\" (UID: \"cc044107-9fe4-47a2-9bf5-4411b79bb4db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.365368 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.365285    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:54.413331 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.413288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:54.498907 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.498877    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"]
Jul 08 18:26:54.501226 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:26:54.501196    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc044107_9fe4_47a2_9bf5_4411b79bb4db.slice/crio-aac0964f01afb8a0c25708a59d3481e6d6244031a08ef3c43b8be5e380b136e3 WatchSource:0}: Error finding container aac0964f01afb8a0c25708a59d3481e6d6244031a08ef3c43b8be5e380b136e3: Status 404 returned error can't find the container with id aac0964f01afb8a0c25708a59d3481e6d6244031a08ef3c43b8be5e380b136e3
Jul 08 18:26:54.790875 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:54.790835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" event={"ID":"cc044107-9fe4-47a2-9bf5-4411b79bb4db","Type":"ContainerStarted","Data":"aac0964f01afb8a0c25708a59d3481e6d6244031a08ef3c43b8be5e380b136e3"}
Jul 08 18:26:56.101545 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:56.101499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:56.151215 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:56.151179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:56.902446 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:56.902413    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:26:56.902533 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:56.902518    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:26:56.902575 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:56.902552    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:26:57.806486 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:57.806446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" event={"ID":"cc044107-9fe4-47a2-9bf5-4411b79bb4db","Type":"ContainerStarted","Data":"57b6dd90ea0cf2ee76736efeab2a59f0c6b28606f16b67593b42f0180af2706e"}
Jul 08 18:26:57.825649 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:57.825599    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" podStartSLOduration=1.426523185 podStartE2EDuration="3.825585219s" totalImagesPullingTime="2.399062034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:26:57.824018718 +0000 UTC m=+656.859675362" watchObservedRunningTime="2026-07-08 18:26:57.825585219 +0000 UTC m=+656.861241863"
Jul 08 18:26:58.366229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.366192    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:58.371226 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.371201    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:58.811059 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.811028    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:58.812141 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.812114    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:26:58.839982 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.839945    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"]
Jul 08 18:26:58.841670 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.841637    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:58.863581 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.863550    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"]
Jul 08 18:26:58.863812 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.863683    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:26:58.866270 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.866245    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9z6ft\""
Jul 08 18:26:58.866396 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.866248    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 18:26:58.933789 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.933752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"]
Jul 08 18:26:58.934600 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.934570    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:58.996529 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.996499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4q22\" (UniqueName: \"kubernetes.io/projected/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-kube-api-access-s4q22\") pod \"limitador-limitador-64c94fd64f-fm6mk\" (UID: \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:26:58.996699 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:58.996535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-config-file\") pod \"limitador-limitador-64c94fd64f-fm6mk\" (UID: \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:26:59.030635 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.030595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:59.097277 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.097193    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4q22\" (UniqueName: \"kubernetes.io/projected/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-kube-api-access-s4q22\") pod \"limitador-limitador-64c94fd64f-fm6mk\" (UID: \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:26:59.097277 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.097233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-config-file\") pod \"limitador-limitador-64c94fd64f-fm6mk\" (UID: \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:26:59.097878 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.097859    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-config-file\") pod \"limitador-limitador-64c94fd64f-fm6mk\" (UID: \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:26:59.105222 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.105191    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4q22\" (UniqueName: \"kubernetes.io/projected/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-kube-api-access-s4q22\") pod \"limitador-limitador-64c94fd64f-fm6mk\" (UID: \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:26:59.175806 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.175771    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:26:59.321721 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.321654    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"]
Jul 08 18:26:59.323958 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:26:59.323931    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0db5c2_7a0a_4360_8d0f_6a72fd75000b.slice/crio-a58e390ee27d04ca2d6c3967a932c65ccfc141cdd81da42ac2eb1855c4e040b3 WatchSource:0}: Error finding container a58e390ee27d04ca2d6c3967a932c65ccfc141cdd81da42ac2eb1855c4e040b3: Status 404 returned error can't find the container with id a58e390ee27d04ca2d6c3967a932c65ccfc141cdd81da42ac2eb1855c4e040b3
Jul 08 18:26:59.673534 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.673505    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:59.774576 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.774534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:26:59.815916 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:26:59.815874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk" event={"ID":"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b","Type":"ContainerStarted","Data":"a58e390ee27d04ca2d6c3967a932c65ccfc141cdd81da42ac2eb1855c4e040b3"}
Jul 08 18:27:02.830710 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:02.830676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk" event={"ID":"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b","Type":"ContainerStarted","Data":"88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da"}
Jul 08 18:27:02.831090 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:02.830787    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:27:02.846225 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:02.846142    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk" podStartSLOduration=2.213094365 podStartE2EDuration="4.8461277s" totalImagesPullingTime="2.633033335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:02.845673085 +0000 UTC m=+661.881329731" watchObservedRunningTime="2026-07-08 18:27:02.8461277 +0000 UTC m=+661.881784345"
Jul 08 18:27:13.835549 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:13.835519    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:27:15.591126 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:15.591089    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"]
Jul 08 18:27:15.591597 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:15.591315    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk" podUID="8d0db5c2-7a0a-4360-8d0f-6a72fd75000b" containerName="limitador" containerID="cri-o://88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da" gracePeriod=30
Jul 08 18:27:16.534932 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.534900    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:27:16.651849 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.651809    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-config-file\") pod \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\" (UID: \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\") "
Jul 08 18:27:16.652344 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.651922    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4q22\" (UniqueName: \"kubernetes.io/projected/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-kube-api-access-s4q22\") pod \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\" (UID: \"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b\") "
Jul 08 18:27:16.652344 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.652202    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-config-file" (OuterVolumeSpecName: "config-file") pod "8d0db5c2-7a0a-4360-8d0f-6a72fd75000b" (UID: "8d0db5c2-7a0a-4360-8d0f-6a72fd75000b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:27:16.654164 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.654093    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-kube-api-access-s4q22" (OuterVolumeSpecName: "kube-api-access-s4q22") pod "8d0db5c2-7a0a-4360-8d0f-6a72fd75000b" (UID: "8d0db5c2-7a0a-4360-8d0f-6a72fd75000b"). InnerVolumeSpecName "kube-api-access-s4q22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:27:16.753012 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.752970    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4q22\" (UniqueName: \"kubernetes.io/projected/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-kube-api-access-s4q22\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:27:16.753012 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.753005    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b-config-file\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:27:16.890201 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.890144    2558 generic.go:356] "Generic (PLEG): container finished" podID="8d0db5c2-7a0a-4360-8d0f-6a72fd75000b" containerID="88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da" exitCode=0
Jul 08 18:27:16.890358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.890208    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"
Jul 08 18:27:16.890358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.890232    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk" event={"ID":"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b","Type":"ContainerDied","Data":"88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da"}
Jul 08 18:27:16.890358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.890298    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fm6mk" event={"ID":"8d0db5c2-7a0a-4360-8d0f-6a72fd75000b","Type":"ContainerDied","Data":"a58e390ee27d04ca2d6c3967a932c65ccfc141cdd81da42ac2eb1855c4e040b3"}
Jul 08 18:27:16.890358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.890318    2558 scope.go:117] "RemoveContainer" containerID="88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da"
Jul 08 18:27:16.898837 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.898817    2558 scope.go:117] "RemoveContainer" containerID="88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da"
Jul 08 18:27:16.899058 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:27:16.899042    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da\": container with ID starting with 88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da not found: ID does not exist" containerID="88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da"
Jul 08 18:27:16.899104 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.899066    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da"} err="failed to get container status \"88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da\": rpc error: code = NotFound desc = could not find container \"88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da\": container with ID starting with 88c78bdc4846ea8e9f04f9b863a14c14197808ef1ec4efb1ab83a4dd7ea7c8da not found: ID does not exist"
Jul 08 18:27:16.911781 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.911713    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"]
Jul 08 18:27:16.914565 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:16.914543    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fm6mk"]
Jul 08 18:27:17.481057 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:17.481025    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0db5c2-7a0a-4360-8d0f-6a72fd75000b" path="/var/lib/kubelet/pods/8d0db5c2-7a0a-4360-8d0f-6a72fd75000b/volumes"
Jul 08 18:27:19.978841 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:19.978799    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:20.077666 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.077626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:20.452827 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.452796    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"]
Jul 08 18:27:20.453111 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.453098    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0db5c2-7a0a-4360-8d0f-6a72fd75000b" containerName="limitador"
Jul 08 18:27:20.453173 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.453113    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0db5c2-7a0a-4360-8d0f-6a72fd75000b" containerName="limitador"
Jul 08 18:27:20.453219 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.453209    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0db5c2-7a0a-4360-8d0f-6a72fd75000b" containerName="limitador"
Jul 08 18:27:20.457596 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.457577    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:20.460438 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.460411    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 18:27:20.460616 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.460446    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 18:27:20.461248 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.461225    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 18:27:20.461424 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.461227    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-86pbp\""
Jul 08 18:27:20.466200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.466172    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"]
Jul 08 18:27:20.480595 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.480552    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:20.587052 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.587008    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2ttg\" (UniqueName: \"kubernetes.io/projected/9772df3d-bd26-466a-9b07-c90cf48a150a-kube-api-access-f2ttg\") pod \"postgres-69fb4594cf-r4bmg\" (UID: \"9772df3d-bd26-466a-9b07-c90cf48a150a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:20.587291 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.587110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9772df3d-bd26-466a-9b07-c90cf48a150a-data\") pod \"postgres-69fb4594cf-r4bmg\" (UID: \"9772df3d-bd26-466a-9b07-c90cf48a150a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:20.687736 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.687700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9772df3d-bd26-466a-9b07-c90cf48a150a-data\") pod \"postgres-69fb4594cf-r4bmg\" (UID: \"9772df3d-bd26-466a-9b07-c90cf48a150a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:20.687929 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.687777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2ttg\" (UniqueName: \"kubernetes.io/projected/9772df3d-bd26-466a-9b07-c90cf48a150a-kube-api-access-f2ttg\") pod \"postgres-69fb4594cf-r4bmg\" (UID: \"9772df3d-bd26-466a-9b07-c90cf48a150a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:20.688120 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.688101    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9772df3d-bd26-466a-9b07-c90cf48a150a-data\") pod \"postgres-69fb4594cf-r4bmg\" (UID: \"9772df3d-bd26-466a-9b07-c90cf48a150a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:20.696399 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.696371    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2ttg\" (UniqueName: \"kubernetes.io/projected/9772df3d-bd26-466a-9b07-c90cf48a150a-kube-api-access-f2ttg\") pod \"postgres-69fb4594cf-r4bmg\" (UID: \"9772df3d-bd26-466a-9b07-c90cf48a150a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:20.768943 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.768845    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:20.905680 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:20.905648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"]
Jul 08 18:27:20.908554 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:27:20.908527    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9772df3d_bd26_466a_9b07_c90cf48a150a.slice/crio-6d7b2cf5bf4b4679670e67b5694f8cffc6857245cdad5bfff1b4e7c303a7be9a WatchSource:0}: Error finding container 6d7b2cf5bf4b4679670e67b5694f8cffc6857245cdad5bfff1b4e7c303a7be9a: Status 404 returned error can't find the container with id 6d7b2cf5bf4b4679670e67b5694f8cffc6857245cdad5bfff1b4e7c303a7be9a
Jul 08 18:27:21.915310 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:21.915265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg" event={"ID":"9772df3d-bd26-466a-9b07-c90cf48a150a","Type":"ContainerStarted","Data":"6d7b2cf5bf4b4679670e67b5694f8cffc6857245cdad5bfff1b4e7c303a7be9a"}
Jul 08 18:27:25.935302 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:25.935263    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg" event={"ID":"9772df3d-bd26-466a-9b07-c90cf48a150a","Type":"ContainerStarted","Data":"8bf7dfe8d5c33d2f20acc66514988435767aff5c9ff4223ea83c38ad2d455bff"}
Jul 08 18:27:25.935693 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:25.935375    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:25.951361 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:25.951305    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg" podStartSLOduration=1.053014993 podStartE2EDuration="5.95129005s" totalImagesPullingTime="4.898275057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:25.949811152 +0000 UTC m=+684.985467797" watchObservedRunningTime="2026-07-08 18:27:25.95129005 +0000 UTC m=+684.986946695"
Jul 08 18:27:31.970577 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:31.970546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r4bmg"
Jul 08 18:27:32.300105 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:32.300019    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:32.492341 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:32.492306    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:34.484218 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:34.484183    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:37.866574 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.866542    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:37.878210 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.878176    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c74c666-glxnt"]
Jul 08 18:27:37.891210 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.891182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:37.894235 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.894207    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-scmdl\""
Jul 08 18:27:37.894395 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.894328    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c74c666-glxnt"]
Jul 08 18:27:37.894395 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.894249    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 18:27:37.894395 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.894252    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 18:27:37.922506 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.922473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert\") pod \"maas-controller-c74c666-glxnt\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") " pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:37.922667 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.922530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/6dd07101-b1e9-4df3-a353-c28a32f4a775-kube-api-access-tmqvm\") pod \"maas-controller-c74c666-glxnt\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") " pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:37.967037 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:37.967001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:38.023380 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.023339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert\") pod \"maas-controller-c74c666-glxnt\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") " pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:38.023586 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.023395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/6dd07101-b1e9-4df3-a353-c28a32f4a775-kube-api-access-tmqvm\") pod \"maas-controller-c74c666-glxnt\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") " pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:38.023586 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:27:38.023505    2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 18:27:38.023706 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:27:38.023591    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert podName:6dd07101-b1e9-4df3-a353-c28a32f4a775 nodeName:}" failed. No retries permitted until 2026-07-08 18:27:38.523567745 +0000 UTC m=+697.559224368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert") pod "maas-controller-c74c666-glxnt" (UID: "6dd07101-b1e9-4df3-a353-c28a32f4a775") : secret "maas-controller-webhook-cert" not found
Jul 08 18:27:38.034006 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.033969    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:38.034930 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.034909    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/6dd07101-b1e9-4df3-a353-c28a32f4a775-kube-api-access-tmqvm\") pod \"maas-controller-c74c666-glxnt\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") " pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:38.375883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.375850    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:38.527386 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.527351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert\") pod \"maas-controller-c74c666-glxnt\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") " pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:38.529769 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.529745    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert\") pod \"maas-controller-c74c666-glxnt\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") " pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:38.803108 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.803053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:38.934968 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.934920    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c74c666-glxnt"]
Jul 08 18:27:38.937195 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:27:38.937140    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd07101_b1e9_4df3_a353_c28a32f4a775.slice/crio-189ffac08d0b5c3b83c575b5dd955d158be3282d64f40306a80e32a42f91fd91 WatchSource:0}: Error finding container 189ffac08d0b5c3b83c575b5dd955d158be3282d64f40306a80e32a42f91fd91: Status 404 returned error can't find the container with id 189ffac08d0b5c3b83c575b5dd955d158be3282d64f40306a80e32a42f91fd91
Jul 08 18:27:38.993113 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:38.993076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c74c666-glxnt" event={"ID":"6dd07101-b1e9-4df3-a353-c28a32f4a775","Type":"ContainerStarted","Data":"189ffac08d0b5c3b83c575b5dd955d158be3282d64f40306a80e32a42f91fd91"}
Jul 08 18:27:41.727380 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:41.727342    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:41.862505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:41.862418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:42.007656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:42.007625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c74c666-glxnt" event={"ID":"6dd07101-b1e9-4df3-a353-c28a32f4a775","Type":"ContainerStarted","Data":"b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec"}
Jul 08 18:27:42.007837 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:42.007745    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:42.027575 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:42.027528    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c74c666-glxnt" podStartSLOduration=2.4315597589999998 podStartE2EDuration="5.027513482s" totalImagesPullingTime="2.595953723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:42.02647842 +0000 UTC m=+701.062135086" watchObservedRunningTime="2026-07-08 18:27:42.027513482 +0000 UTC m=+701.063170136"
Jul 08 18:27:52.708676 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:52.708634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:27:53.018460 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.018363    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:53.073858 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.073825    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c74c666-glxnt"]
Jul 08 18:27:53.074068 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.074026    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c74c666-glxnt" podUID="6dd07101-b1e9-4df3-a353-c28a32f4a775" containerName="manager" containerID="cri-o://b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec" gracePeriod=30
Jul 08 18:27:53.322010 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.321947    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:53.355848 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.355811    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert\") pod \"6dd07101-b1e9-4df3-a353-c28a32f4a775\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") "
Jul 08 18:27:53.356020 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.355882    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/6dd07101-b1e9-4df3-a353-c28a32f4a775-kube-api-access-tmqvm\") pod \"6dd07101-b1e9-4df3-a353-c28a32f4a775\" (UID: \"6dd07101-b1e9-4df3-a353-c28a32f4a775\") "
Jul 08 18:27:53.357998 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.357959    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6dd07101-b1e9-4df3-a353-c28a32f4a775" (UID: "6dd07101-b1e9-4df3-a353-c28a32f4a775"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:27:53.358142 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.358109    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd07101-b1e9-4df3-a353-c28a32f4a775-kube-api-access-tmqvm" (OuterVolumeSpecName: "kube-api-access-tmqvm") pod "6dd07101-b1e9-4df3-a353-c28a32f4a775" (UID: "6dd07101-b1e9-4df3-a353-c28a32f4a775"). InnerVolumeSpecName "kube-api-access-tmqvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:27:53.456659 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.456602    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6dd07101-b1e9-4df3-a353-c28a32f4a775-webhook-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:27:53.456659 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:53.456655    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmqvm\" (UniqueName: \"kubernetes.io/projected/6dd07101-b1e9-4df3-a353-c28a32f4a775-kube-api-access-tmqvm\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:27:54.058160 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.058112    2558 generic.go:356] "Generic (PLEG): container finished" podID="6dd07101-b1e9-4df3-a353-c28a32f4a775" containerID="b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec" exitCode=0
Jul 08 18:27:54.058651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.058194    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c74c666-glxnt"
Jul 08 18:27:54.058651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.058203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c74c666-glxnt" event={"ID":"6dd07101-b1e9-4df3-a353-c28a32f4a775","Type":"ContainerDied","Data":"b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec"}
Jul 08 18:27:54.058651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.058256    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c74c666-glxnt" event={"ID":"6dd07101-b1e9-4df3-a353-c28a32f4a775","Type":"ContainerDied","Data":"189ffac08d0b5c3b83c575b5dd955d158be3282d64f40306a80e32a42f91fd91"}
Jul 08 18:27:54.058651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.058279    2558 scope.go:117] "RemoveContainer" containerID="b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec"
Jul 08 18:27:54.066559 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.066540    2558 scope.go:117] "RemoveContainer" containerID="b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec"
Jul 08 18:27:54.066832 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:27:54.066815    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec\": container with ID starting with b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec not found: ID does not exist" containerID="b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec"
Jul 08 18:27:54.066875 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.066839    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec"} err="failed to get container status \"b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec\": rpc error: code = NotFound desc = could not find container \"b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec\": container with ID starting with b1e9c727697314315b20ec5474edc7234b7c066c0fc028a2bbd0309f9bc9beec not found: ID does not exist"
Jul 08 18:27:54.073923 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.073898    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c74c666-glxnt"]
Jul 08 18:27:54.077575 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:54.077551    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c74c666-glxnt"]
Jul 08 18:27:55.482031 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:27:55.481995    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dd07101-b1e9-4df3-a353-c28a32f4a775" path="/var/lib/kubelet/pods/6dd07101-b1e9-4df3-a353-c28a32f4a775/volumes"
Jul 08 18:28:09.143193 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:09.143137    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:09.197989 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:09.197959    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:17.137437 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.137390    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:17.560082 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.559997    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:17.618349 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.618314    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"]
Jul 08 18:28:17.618621 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.618609    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd07101-b1e9-4df3-a353-c28a32f4a775" containerName="manager"
Jul 08 18:28:17.618666 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.618622    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd07101-b1e9-4df3-a353-c28a32f4a775" containerName="manager"
Jul 08 18:28:17.618703 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.618678    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd07101-b1e9-4df3-a353-c28a32f4a775" containerName="manager"
Jul 08 18:28:17.643582 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.643553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"]
Jul 08 18:28:17.643736 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.643674    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.646209 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.646188    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dvcs5\""
Jul 08 18:28:17.646334 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.646191    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 18:28:17.732074 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.732034    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:17.760257 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.760217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8902deb-c64b-4a47-834a-323dc5bd5edd-openshift-service-ca\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.760414 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.760310    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjr5x\" (UniqueName: \"kubernetes.io/projected/c8902deb-c64b-4a47-834a-323dc5bd5edd-kube-api-access-vjr5x\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.760414 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.760365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8902deb-c64b-4a47-834a-323dc5bd5edd-maas-api-tls\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.861105 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.861015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjr5x\" (UniqueName: \"kubernetes.io/projected/c8902deb-c64b-4a47-834a-323dc5bd5edd-kube-api-access-vjr5x\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.861105 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.861077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8902deb-c64b-4a47-834a-323dc5bd5edd-maas-api-tls\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.861386 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.861114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8902deb-c64b-4a47-834a-323dc5bd5edd-openshift-service-ca\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.861948 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.861926    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8902deb-c64b-4a47-834a-323dc5bd5edd-openshift-service-ca\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.863651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.863633    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8902deb-c64b-4a47-834a-323dc5bd5edd-maas-api-tls\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.868481 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.868458    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjr5x\" (UniqueName: \"kubernetes.io/projected/c8902deb-c64b-4a47-834a-323dc5bd5edd-kube-api-access-vjr5x\") pod \"maas-api-9b47755f7-kvtq6\" (UID: \"c8902deb-c64b-4a47-834a-323dc5bd5edd\") " pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:17.954103 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:17.954070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:18.009548 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:18.009510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:18.091650 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:18.091626    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"]
Jul 08 18:28:18.093942 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:28:18.093909    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8902deb_c64b_4a47_834a_323dc5bd5edd.slice/crio-f1ae0da441607cb2808cdcaa6fe6b7de62daf6c93da94ee24f99057752cf2e89 WatchSource:0}: Error finding container f1ae0da441607cb2808cdcaa6fe6b7de62daf6c93da94ee24f99057752cf2e89: Status 404 returned error can't find the container with id f1ae0da441607cb2808cdcaa6fe6b7de62daf6c93da94ee24f99057752cf2e89
Jul 08 18:28:18.095319 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:18.095272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:18.159129 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:18.159089    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6" event={"ID":"c8902deb-c64b-4a47-834a-323dc5bd5edd","Type":"ContainerStarted","Data":"f1ae0da441607cb2808cdcaa6fe6b7de62daf6c93da94ee24f99057752cf2e89"}
Jul 08 18:28:21.177242 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:21.177197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6" event={"ID":"c8902deb-c64b-4a47-834a-323dc5bd5edd","Type":"ContainerStarted","Data":"8a33648ee12dcd29f054c6c3b7b6f6806cb7eecd083649fd646ee92683d1ae59"}
Jul 08 18:28:21.177625 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:21.177290    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:21.195288 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:21.195239    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6" podStartSLOduration=1.936997502 podStartE2EDuration="4.195222917s" totalImagesPullingTime="2.258225415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:28:21.193865871 +0000 UTC m=+740.229522517" watchObservedRunningTime="2026-07-08 18:28:21.195222917 +0000 UTC m=+740.230879561"
Jul 08 18:28:26.201031 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:26.200995    2558 generic.go:356] "Generic (PLEG): container finished" podID="cc044107-9fe4-47a2-9bf5-4411b79bb4db" containerID="57b6dd90ea0cf2ee76736efeab2a59f0c6b28606f16b67593b42f0180af2706e" exitCode=0
Jul 08 18:28:26.201471 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:26.201057    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" event={"ID":"cc044107-9fe4-47a2-9bf5-4411b79bb4db","Type":"ContainerDied","Data":"57b6dd90ea0cf2ee76736efeab2a59f0c6b28606f16b67593b42f0180af2706e"}
Jul 08 18:28:26.201471 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:26.201416    2558 scope.go:117] "RemoveContainer" containerID="57b6dd90ea0cf2ee76736efeab2a59f0c6b28606f16b67593b42f0180af2706e"
Jul 08 18:28:26.202367 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:26.202339    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:28:26.202437 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:26.202411    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:28:26.202470 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:26.202445    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:28:27.187389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:27.187358    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-9b47755f7-kvtq6"
Jul 08 18:28:27.207646 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:27.207613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" event={"ID":"cc044107-9fe4-47a2-9bf5-4411b79bb4db","Type":"ContainerStarted","Data":"f95f1165affd4f33bc07712400fb00983bae9b3fb6d6adf3be90b79f5f5cc876"}
Jul 08 18:28:27.366334 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:27.366298    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:28:27.367398 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:27.367376    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9hwdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Jul 08 18:28:27.367456 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:27.367425    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" podUID="cc044107-9fe4-47a2-9bf5-4411b79bb4db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Jul 08 18:28:28.127750 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:28.127704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:28.231854 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:28.231812    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:28.366498 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:28.366462    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9hwdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Jul 08 18:28:28.366666 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:28.366517    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" podUID="cc044107-9fe4-47a2-9bf5-4411b79bb4db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Jul 08 18:28:28.811674 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:28.811633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:28:29.365604 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:29.365567    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9hwdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Jul 08 18:28:29.365952 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:29.365628    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" podUID="cc044107-9fe4-47a2-9bf5-4411b79bb4db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Jul 08 18:28:30.366174 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:30.366116    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9hwdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Jul 08 18:28:30.366557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:30.366204    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn" podUID="cc044107-9fe4-47a2-9bf5-4411b79bb4db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Jul 08 18:28:31.370210 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:31.370181    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:28:31.371242 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:31.371225    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9hwdn"
Jul 08 18:28:34.889375 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.889343    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"]
Jul 08 18:28:34.892994 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.892966    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:34.896350 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.896325    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 18:28:34.896350 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.896350    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 18:28:34.896556 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.896327    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 18:28:34.896556 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.896325    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tlxrv\""
Jul 08 18:28:34.901138 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.901114    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"]
Jul 08 18:28:34.910105 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.910079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:34.910257 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.910109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:34.910257 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.910132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41b98e65-fb12-46c8-85e7-cfc67b2afa35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:34.910257 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.910162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:34.910257 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.910247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j647\" (UniqueName: \"kubernetes.io/projected/41b98e65-fb12-46c8-85e7-cfc67b2afa35-kube-api-access-5j647\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:34.910474 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.910282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:34.980490 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:34.980450    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:35.011391 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.011391 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.011591 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41b98e65-fb12-46c8-85e7-cfc67b2afa35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.011591 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.011591 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j647\" (UniqueName: \"kubernetes.io/projected/41b98e65-fb12-46c8-85e7-cfc67b2afa35-kube-api-access-5j647\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.011591 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.011843 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011818    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.011901 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011843    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.011944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.011900    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.013724 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.013703    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41b98e65-fb12-46c8-85e7-cfc67b2afa35-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.014008 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.013990    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41b98e65-fb12-46c8-85e7-cfc67b2afa35-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.020679 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.020653    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j647\" (UniqueName: \"kubernetes.io/projected/41b98e65-fb12-46c8-85e7-cfc67b2afa35-kube-api-access-5j647\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g\" (UID: \"41b98e65-fb12-46c8-85e7-cfc67b2afa35\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.203749 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.203655    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:35.334063 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.334041    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"]
Jul 08 18:28:35.335797 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:28:35.335767    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b98e65_fb12_46c8_85e7_cfc67b2afa35.slice/crio-da79d29abe9a2b1362e1cf58edfb8b62ffaa23aea77a3e607b79315965d73dc8 WatchSource:0}: Error finding container da79d29abe9a2b1362e1cf58edfb8b62ffaa23aea77a3e607b79315965d73dc8: Status 404 returned error can't find the container with id da79d29abe9a2b1362e1cf58edfb8b62ffaa23aea77a3e607b79315965d73dc8
Jul 08 18:28:35.337095 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:35.337074    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:28:36.249242 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:36.249196    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g" event={"ID":"41b98e65-fb12-46c8-85e7-cfc67b2afa35","Type":"ContainerStarted","Data":"da79d29abe9a2b1362e1cf58edfb8b62ffaa23aea77a3e607b79315965d73dc8"}
Jul 08 18:28:37.256016 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:37.255984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g" event={"ID":"41b98e65-fb12-46c8-85e7-cfc67b2afa35","Type":"ContainerStarted","Data":"31972e8821e9b66d9c1f6c7b8f04941da4c2ba21f3b7ac8e3f4fbebecdc08c1d"}
Jul 08 18:28:37.272564 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:37.272514    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g" podStartSLOduration=2.123671162 podStartE2EDuration="3.272496284s" totalImagesPullingTime="1.148825122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:28:37.27210934 +0000 UTC m=+756.307766001" watchObservedRunningTime="2026-07-08 18:28:37.272496284 +0000 UTC m=+756.308152930"
Jul 08 18:28:45.204328 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:45.204289    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:45.204733 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:45.204377    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:45.216916 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:45.216888    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:45.302568 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:45.302539    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g"
Jul 08 18:28:47.506003 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:47.505968    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:54.986201 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:54.986164    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"]
Jul 08 18:28:54.990752 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:54.990721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:54.993131 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:54.993109    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 18:28:54.997999 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:54.997977    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"]
Jul 08 18:28:55.075729 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.075694    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:28:55.091911 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.091878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.092098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.091938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.092098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.092029    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.092098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.092062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e79ac5d6-4781-43fb-825c-099930d8eb73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.092098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.092088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.092303 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.092110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5htgj\" (UniqueName: \"kubernetes.io/projected/e79ac5d6-4781-43fb-825c-099930d8eb73-kube-api-access-5htgj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.193534 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.193491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.193534 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.193538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e79ac5d6-4781-43fb-825c-099930d8eb73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.193796 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.193562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.193796 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.193585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5htgj\" (UniqueName: \"kubernetes.io/projected/e79ac5d6-4781-43fb-825c-099930d8eb73-kube-api-access-5htgj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.193796 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.193615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.193796 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.193677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.194021 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.193994    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.194085 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.194049    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.194208 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.194192    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.195848 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.195830    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e79ac5d6-4781-43fb-825c-099930d8eb73-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.196243 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.196223    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e79ac5d6-4781-43fb-825c-099930d8eb73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.201105 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.201087    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5htgj\" (UniqueName: \"kubernetes.io/projected/e79ac5d6-4781-43fb-825c-099930d8eb73-kube-api-access-5htgj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cnnrt\" (UID: \"e79ac5d6-4781-43fb-825c-099930d8eb73\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.301583 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.301492    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:28:55.435720 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:55.435693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"]
Jul 08 18:28:55.438505 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:28:55.438472    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79ac5d6_4781_43fb_825c_099930d8eb73.slice/crio-d38cb48aaa3c6f7f0d90c989c5c60950230ba6b8d11eac0cfcf5f323e91053a5 WatchSource:0}: Error finding container d38cb48aaa3c6f7f0d90c989c5c60950230ba6b8d11eac0cfcf5f323e91053a5: Status 404 returned error can't find the container with id d38cb48aaa3c6f7f0d90c989c5c60950230ba6b8d11eac0cfcf5f323e91053a5
Jul 08 18:28:56.338135 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:56.338101    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt" event={"ID":"e79ac5d6-4781-43fb-825c-099930d8eb73","Type":"ContainerStarted","Data":"f037e549320554048af3abe77938ffe97e454ea608575bd9a9c4a5a5dc264370"}
Jul 08 18:28:56.338553 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:56.338174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt" event={"ID":"e79ac5d6-4781-43fb-825c-099930d8eb73","Type":"ContainerStarted","Data":"d38cb48aaa3c6f7f0d90c989c5c60950230ba6b8d11eac0cfcf5f323e91053a5"}
Jul 08 18:28:56.357672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:28:56.357608    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt" podStartSLOduration=2.127815193 podStartE2EDuration="2.357590129s" totalImagesPullingTime="229.774936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:28:56.356826365 +0000 UTC m=+775.392483011" watchObservedRunningTime="2026-07-08 18:28:56.357590129 +0000 UTC m=+775.393246774"
Jul 08 18:29:03.180704 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.180669    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"]
Jul 08 18:29:03.184120 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.184098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.186628 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.186606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 08 18:29:03.192263 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.192243    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"]
Jul 08 18:29:03.215041 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.214996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:29:03.271539 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.271509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c62549fe-74ff-4d62-937e-a2cdd453326f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.271708 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.271556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.271708 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.271629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwgtz\" (UniqueName: \"kubernetes.io/projected/c62549fe-74ff-4d62-937e-a2cdd453326f-kube-api-access-mwgtz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.271708 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.271661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.271835 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.271754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.271835 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.271785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373124 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwgtz\" (UniqueName: \"kubernetes.io/projected/c62549fe-74ff-4d62-937e-a2cdd453326f-kube-api-access-mwgtz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373338 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373544 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c62549fe-74ff-4d62-937e-a2cdd453326f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373613 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373592    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373688 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373665    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.373743 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.373725    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.375525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.375503    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c62549fe-74ff-4d62-937e-a2cdd453326f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.375643 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.375627    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c62549fe-74ff-4d62-937e-a2cdd453326f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.381751 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.381719    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwgtz\" (UniqueName: \"kubernetes.io/projected/c62549fe-74ff-4d62-937e-a2cdd453326f-kube-api-access-mwgtz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm\" (UID: \"c62549fe-74ff-4d62-937e-a2cdd453326f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.495774 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.495682    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:03.626884 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:03.626855    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"]
Jul 08 18:29:03.629777 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:29:03.629746    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62549fe_74ff_4d62_937e_a2cdd453326f.slice/crio-c1c36d0ad22d4b2fdc18f4ffab574b76cbc1efe1fc01fccea0fbc42b81348ab1 WatchSource:0}: Error finding container c1c36d0ad22d4b2fdc18f4ffab574b76cbc1efe1fc01fccea0fbc42b81348ab1: Status 404 returned error can't find the container with id c1c36d0ad22d4b2fdc18f4ffab574b76cbc1efe1fc01fccea0fbc42b81348ab1
Jul 08 18:29:04.373221 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:04.373181    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm" event={"ID":"c62549fe-74ff-4d62-937e-a2cdd453326f","Type":"ContainerStarted","Data":"3098f1c2d4dda71d1cc8055e3bf85e28b53837fc39e14bb5b911fbbb50faf948"}
Jul 08 18:29:04.373622 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:04.373236    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm" event={"ID":"c62549fe-74ff-4d62-937e-a2cdd453326f","Type":"ContainerStarted","Data":"c1c36d0ad22d4b2fdc18f4ffab574b76cbc1efe1fc01fccea0fbc42b81348ab1"}
Jul 08 18:29:04.393273 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:04.393221    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm" podStartSLOduration=1.205011324 podStartE2EDuration="1.393204191s" totalImagesPullingTime="188.192867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:29:04.390854177 +0000 UTC m=+783.426510821" watchObservedRunningTime="2026-07-08 18:29:04.393204191 +0000 UTC m=+783.428860836"
Jul 08 18:29:05.302926 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:05.302889    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:29:05.303121 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:05.302963    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:29:05.316514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:05.316474    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:29:05.389196 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:05.389145    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cnnrt"
Jul 08 18:29:13.496183 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:13.496131    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:13.496591 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:13.496212    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:13.508491 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:13.508456    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:14.429062 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:14.429030    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm"
Jul 08 18:29:14.821007 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:14.820918    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:29:27.714133 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:29:27.714092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:30:15.789920 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:30:15.789878    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:30:19.407129 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:30:19.407089    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:30:26.050682 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:30:26.050627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:30:26.146142 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:30:26.146108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:30:27.152707 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:30:27.152674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:30:27.248858 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:30:27.248817    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:31:13.117603 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:31:13.117497    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:31:36.493278 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:31:36.493242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:31:38.039534 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:31:38.039492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:16.906557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:16.906515    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:17.002917 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:17.002864    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:17.184429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:17.184328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:22.965315 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:22.965276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:23.034277 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:23.034244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:23.112448 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:23.112412    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:23.394185 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:23.394134    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:29.300348 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:29.300314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:29.401267 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:29.401223    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:39.076325 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:39.076291    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:32:39.177251 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:32:39.177215    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:33:47.872344 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:33:47.872307    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:36:21.966442 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:36:21.966403    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:39:36.364509 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:39:36.364461    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:15.015427 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:41:15.015388    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:41:45.082917 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:41:45.082818    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:20.852385 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:43:20.852264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:23.437101 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:43:23.437060    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:29.680424 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:43:29.680383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:37.958433 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:43:37.958376    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:43:43.200222 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:43:43.200188    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:45:39.335950 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:45:39.335916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:55.042983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:49:55.042944    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:55.130389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:49:55.130355    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:49:55.448184 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:49:55.448130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:01.168057 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.168020    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:01.228125 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.228092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:01.363311 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.363287    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"]
Jul 08 18:50:01.366434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.366416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.368799 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.368783    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ccb6098f-openshift-default-dockercfg-cddct\""
Jul 08 18:50:01.385203 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.385170    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"]
Jul 08 18:50:01.387443 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.387418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:01.482533 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-certs\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.482533 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482488    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ltt\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-kube-api-access-s4ltt\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.482533 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e38d66-931b-4824-b3c8-b37ff1846d11-istiod-ca-cert\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.482758 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-credential-socket\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.482758 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-token\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.482758 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-podinfo\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.482758 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-socket\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.482758 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-envoy\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.482924 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.482762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-data\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.486602 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.486576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:01.583485 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-podinfo\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.583485 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-socket\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.583664 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-envoy\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.583664 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-data\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.583664 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-certs\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.583664 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ltt\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-kube-api-access-s4ltt\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.583890 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583861    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e38d66-931b-4824-b3c8-b37ff1846d11-istiod-ca-cert\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.584024 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-credential-socket\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.584024 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.584000    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-data\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.584141 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.583895    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-socket\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.584141 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.584040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-token\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.584141 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.584053    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-certs\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.584383 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.584361    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-credential-socket\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.584487 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.584470    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e38d66-931b-4824-b3c8-b37ff1846d11-istiod-ca-cert\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.585793 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.585776    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-envoy\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.586039 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.586022    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-podinfo\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.591384 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.591353    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ltt\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-kube-api-access-s4ltt\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.591384 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.591359    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-token\") pod \"e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") " pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.679700 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.679650    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ccb6098f-openshift-default-dockercfg-cddct\""
Jul 08 18:50:01.687594 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.687570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:01.824335 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.824309    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"]
Jul 08 18:50:01.827027 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:50:01.826998    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e38d66_931b_4824_b3c8_b37ff1846d11.slice/crio-ecf25404ab0389a567ba708c6331d6f75e1fc3cef53e0cb82f3b9f2ef5bfe560 WatchSource:0}: Error finding container ecf25404ab0389a567ba708c6331d6f75e1fc3cef53e0cb82f3b9f2ef5bfe560: Status 404 returned error can't find the container with id ecf25404ab0389a567ba708c6331d6f75e1fc3cef53e0cb82f3b9f2ef5bfe560
Jul 08 18:50:01.829672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.829637    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:01.829777 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.829720    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:01.829777 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:01.829761    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:02.555719 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.555688    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:02.659693 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.659655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:02.836762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.836681    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv" event={"ID":"f9e38d66-931b-4824-b3c8-b37ff1846d11","Type":"ContainerStarted","Data":"ce33e0668af080cf4f871f785741bfa2978cc20784c635a3a7828a28ab422de1"}
Jul 08 18:50:02.836762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.836740    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv" event={"ID":"f9e38d66-931b-4824-b3c8-b37ff1846d11","Type":"ContainerStarted","Data":"ecf25404ab0389a567ba708c6331d6f75e1fc3cef53e0cb82f3b9f2ef5bfe560"}
Jul 08 18:50:02.886236 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.886169    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv" podStartSLOduration=1.886135902 podStartE2EDuration="1.886135902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:50:02.879374729 +0000 UTC m=+2041.915031372" watchObservedRunningTime="2026-07-08 18:50:02.886135902 +0000 UTC m=+2041.921792546"
Jul 08 18:50:02.981700 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.981668    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"]
Jul 08 18:50:02.985241 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.985216    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:02.987733 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.987707    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ccb6098f-serving-cert\""
Jul 08 18:50:02.996683 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:02.996665    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"]
Jul 08 18:50:03.018514 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.018490    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:03.097073 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.096979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.097073 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.097043    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-openshift-service-ca\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.097307 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.097115    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gsx9\" (UniqueName: \"kubernetes.io/projected/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-kube-api-access-4gsx9\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.198572 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.198537    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gsx9\" (UniqueName: \"kubernetes.io/projected/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-kube-api-access-4gsx9\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.198742 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.198594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.198742 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.198643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-openshift-service-ca\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.198742 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:50:03.198729    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-serving-cert: secret "maas-api-e2e-ait-ccb6098f-serving-cert" not found
Jul 08 18:50:03.198848 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:50:03.198801    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls podName:151aa54c-3fad-41cf-8beb-bfe5ec3f27e2 nodeName:}" failed. No retries permitted until 2026-07-08 18:50:03.698779747 +0000 UTC m=+2042.734436370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls") pod "maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh" (UID: "151aa54c-3fad-41cf-8beb-bfe5ec3f27e2") : secret "maas-api-e2e-ait-ccb6098f-serving-cert" not found
Jul 08 18:50:03.199314 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.199297    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-openshift-service-ca\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.207975 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.207949    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gsx9\" (UniqueName: \"kubernetes.io/projected/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-kube-api-access-4gsx9\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.502636 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.502600    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:03.606186 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.606130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:03.688245 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.688143    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:03.703288 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.703244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.705339 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.705285    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:03.706126 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.706086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:03.706587 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.706568    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls\") pod \"maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:03.840953 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.840870    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:03.841785 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.841765    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:03.896414 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:03.896391    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:04.029594 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:04.029568    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"]
Jul 08 18:50:04.031591 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:50:04.031565    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151aa54c_3fad_41cf_8beb_bfe5ec3f27e2.slice/crio-529756d6c2ee45551bfab70831acea555483ac79390836204b81240cb949944b WatchSource:0}: Error finding container 529756d6c2ee45551bfab70831acea555483ac79390836204b81240cb949944b: Status 404 returned error can't find the container with id 529756d6c2ee45551bfab70831acea555483ac79390836204b81240cb949944b
Jul 08 18:50:04.032951 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:04.032934    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:50:04.846710 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:04.846612    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh" event={"ID":"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2","Type":"ContainerStarted","Data":"df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9"}
Jul 08 18:50:04.846710 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:04.846697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh" event={"ID":"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2","Type":"ContainerStarted","Data":"529756d6c2ee45551bfab70831acea555483ac79390836204b81240cb949944b"}
Jul 08 18:50:04.847141 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:04.846818    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:04.866006 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:04.865962    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh" podStartSLOduration=2.500505362 podStartE2EDuration="2.865949219s" totalImagesPullingTime="365.443857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:50:04.864333644 +0000 UTC m=+2043.899990288" watchObservedRunningTime="2026-07-08 18:50:04.865949219 +0000 UTC m=+2043.901605864"
Jul 08 18:50:05.184868 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:05.184825    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:07.535685 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.535653    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"]
Jul 08 18:50:07.536119 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.535825    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh" podUID="151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" containerName="maas-api" containerID="cri-o://df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9" gracePeriod=30
Jul 08 18:50:07.563208 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.563172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:07.618865 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.618836    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:07.737462 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.737432    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"]
Jul 08 18:50:07.737658 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.737600    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv" podUID="f9e38d66-931b-4824-b3c8-b37ff1846d11" containerName="istio-proxy" containerID="cri-o://ce33e0668af080cf4f871f785741bfa2978cc20784c635a3a7828a28ab422de1" gracePeriod=30
Jul 08 18:50:07.762779 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.762748    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:07.774672 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.774652    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:07.862451 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.862361    2558 generic.go:356] "Generic (PLEG): container finished" podID="151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" containerID="df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9" exitCode=0
Jul 08 18:50:07.862451 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.862409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh" event={"ID":"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2","Type":"ContainerDied","Data":"df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9"}
Jul 08 18:50:07.862656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.862462    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh" event={"ID":"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2","Type":"ContainerDied","Data":"529756d6c2ee45551bfab70831acea555483ac79390836204b81240cb949944b"}
Jul 08 18:50:07.862656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.862416    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"
Jul 08 18:50:07.862656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.862488    2558 scope.go:117] "RemoveContainer" containerID="df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9"
Jul 08 18:50:07.870457 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.870438    2558 scope.go:117] "RemoveContainer" containerID="df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9"
Jul 08 18:50:07.870712 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:50:07.870685    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9\": container with ID starting with df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9 not found: ID does not exist" containerID="df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9"
Jul 08 18:50:07.870811 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.870721    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9"} err="failed to get container status \"df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9\": rpc error: code = NotFound desc = could not find container \"df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9\": container with ID starting with df79aa3001d0a35f4fcdacea9da3efbe20c3346c5ce158716edbbf4abad5d2a9 not found: ID does not exist"
Jul 08 18:50:07.871259 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.871233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:07.942260 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.942237    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-openshift-service-ca\") pod \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") "
Jul 08 18:50:07.942352 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.942334    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls\") pod \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") "
Jul 08 18:50:07.942390 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.942372    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gsx9\" (UniqueName: \"kubernetes.io/projected/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-kube-api-access-4gsx9\") pod \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\" (UID: \"151aa54c-3fad-41cf-8beb-bfe5ec3f27e2\") "
Jul 08 18:50:07.942568 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.942546    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" (UID: "151aa54c-3fad-41cf-8beb-bfe5ec3f27e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:50:07.944371 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.944351    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-kube-api-access-4gsx9" (OuterVolumeSpecName: "kube-api-access-4gsx9") pod "151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" (UID: "151aa54c-3fad-41cf-8beb-bfe5ec3f27e2"). InnerVolumeSpecName "kube-api-access-4gsx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:50:07.944454 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:07.944431    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" (UID: "151aa54c-3fad-41cf-8beb-bfe5ec3f27e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:50:08.043346 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:08.043317    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:08.043346 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:08.043344    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:08.043346 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:08.043353    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gsx9\" (UniqueName: \"kubernetes.io/projected/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2-kube-api-access-4gsx9\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:08.184654 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:08.184627    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"]
Jul 08 18:50:08.187900 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:08.187879    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ccb6098f-75f65897fc-vtwmh"]
Jul 08 18:50:09.481534 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:09.481505    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" path="/var/lib/kubelet/pods/151aa54c-3fad-41cf-8beb-bfe5ec3f27e2/volumes"
Jul 08 18:50:09.699440 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:09.699405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:12.886818 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:12.886774    2558 generic.go:356] "Generic (PLEG): container finished" podID="f9e38d66-931b-4824-b3c8-b37ff1846d11" containerID="ce33e0668af080cf4f871f785741bfa2978cc20784c635a3a7828a28ab422de1" exitCode=0
Jul 08 18:50:12.887189 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:12.886867    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv" event={"ID":"f9e38d66-931b-4824-b3c8-b37ff1846d11","Type":"ContainerDied","Data":"ce33e0668af080cf4f871f785741bfa2978cc20784c635a3a7828a28ab422de1"}
Jul 08 18:50:12.977419 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:12.977394    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:13.086601 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086515    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-certs\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.086601 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086555    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e38d66-931b-4824-b3c8-b37ff1846d11-istiod-ca-cert\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.086601 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086580    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-data\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.086877 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086609    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-credential-socket\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.086877 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086713    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-podinfo\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.086877 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086757    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4ltt\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-kube-api-access-s4ltt\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.086877 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086812    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-envoy\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.087089 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086843    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:13.087089 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086891    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:13.087089 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086871    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-token\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.087089 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086964    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-socket\") pod \"f9e38d66-931b-4824-b3c8-b37ff1846d11\" (UID: \"f9e38d66-931b-4824-b3c8-b37ff1846d11\") "
Jul 08 18:50:13.087089 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.086979    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:13.087089 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.087037    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e38d66-931b-4824-b3c8-b37ff1846d11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:50:13.087428 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.087279    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-certs\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.087428 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.087283    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:13.087428 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.087299    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e38d66-931b-4824-b3c8-b37ff1846d11-istiod-ca-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.087428 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.087312    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-data\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.087428 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.087323    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-credential-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.089137 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.089109    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:13.089295 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.089118    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:50:13.089355 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.089330    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 18:50:13.089355 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.089339    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-kube-api-access-s4ltt" (OuterVolumeSpecName: "kube-api-access-s4ltt") pod "f9e38d66-931b-4824-b3c8-b37ff1846d11" (UID: "f9e38d66-931b-4824-b3c8-b37ff1846d11"). InnerVolumeSpecName "kube-api-access-s4ltt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:50:13.188401 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.188368    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-podinfo\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.188401 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.188395    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4ltt\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-kube-api-access-s4ltt\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.188566 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.188412    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-envoy\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.188566 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.188423    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e38d66-931b-4824-b3c8-b37ff1846d11-istio-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.188566 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.188448    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e38d66-931b-4824-b3c8-b37ff1846d11-workload-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:13.451043 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.451002    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:13.556016 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.555980    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:13.611568 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.611530    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"]
Jul 08 18:50:13.611952 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.611925    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e38d66-931b-4824-b3c8-b37ff1846d11" containerName="istio-proxy"
Jul 08 18:50:13.611952 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.611950    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e38d66-931b-4824-b3c8-b37ff1846d11" containerName="istio-proxy"
Jul 08 18:50:13.612133 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.611958    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" containerName="maas-api"
Jul 08 18:50:13.612133 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.611964    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" containerName="maas-api"
Jul 08 18:50:13.612133 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.612034    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="151aa54c-3fad-41cf-8beb-bfe5ec3f27e2" containerName="maas-api"
Jul 08 18:50:13.612133 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.612046    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e38d66-931b-4824-b3c8-b37ff1846d11" containerName="istio-proxy"
Jul 08 18:50:13.615490 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.615468    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.620117 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.620098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b41ee2bc-openshift-default-dockercfg-lg9rl\""
Jul 08 18:50:13.630934 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.630639    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"]
Jul 08 18:50:13.662108 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.662079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:13.692450 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-podinfo\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.692450 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c6fb1f1-cfd4-473d-9725-d9956a542299-istiod-ca-cert\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.692580 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-envoy\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.692580 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692493    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-data\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.692580 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-credential-socket\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.692580 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-socket\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.692580 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-token\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.692760 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-certs\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.692760 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.692628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fjwp\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-kube-api-access-8fjwp\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.719654 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.719586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:13.793277 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-socket\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793277 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-token\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-certs\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fjwp\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-kube-api-access-8fjwp\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-podinfo\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c6fb1f1-cfd4-473d-9725-d9956a542299-istiod-ca-cert\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793702 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-envoy\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793754 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-data\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793754 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793729    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-socket\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793867 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793751    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-certs\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.793867 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-credential-socket\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.794027 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.793999    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-data\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.794229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.794205    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-credential-socket\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.794316 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.794292    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c6fb1f1-cfd4-473d-9725-d9956a542299-istiod-ca-cert\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.795735 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.795715    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-envoy\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.795958 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.795940    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-podinfo\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.801316 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.801298    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-token\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.801418 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.801387    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fjwp\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-kube-api-access-8fjwp\") pod \"e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") " pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:13.892020 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.891999    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"
Jul 08 18:50:13.892351 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.891999    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv" event={"ID":"f9e38d66-931b-4824-b3c8-b37ff1846d11","Type":"ContainerDied","Data":"ecf25404ab0389a567ba708c6331d6f75e1fc3cef53e0cb82f3b9f2ef5bfe560"}
Jul 08 18:50:13.892351 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.892131    2558 scope.go:117] "RemoveContainer" containerID="ce33e0668af080cf4f871f785741bfa2978cc20784c635a3a7828a28ab422de1"
Jul 08 18:50:13.907534 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.907515    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"]
Jul 08 18:50:13.912241 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.912216    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ccb6098f-openshift-default-844547f865-ldbzv"]
Jul 08 18:50:13.930261 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:13.930242    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:14.058486 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.058461    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"]
Jul 08 18:50:14.060571 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:50:14.060548    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6fb1f1_cfd4_473d_9725_d9956a542299.slice/crio-189afc24a5fc354807831721135b3cf92a37e322e4d337da23c78af476baa887 WatchSource:0}: Error finding container 189afc24a5fc354807831721135b3cf92a37e322e4d337da23c78af476baa887: Status 404 returned error can't find the container with id 189afc24a5fc354807831721135b3cf92a37e322e4d337da23c78af476baa887
Jul 08 18:50:14.063218 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.063188    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:14.063371 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.063262    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:14.069535 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.068512    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:14.757723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.757690    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:14.860460 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.860424    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:14.898203 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.898173    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l" event={"ID":"7c6fb1f1-cfd4-473d-9725-d9956a542299","Type":"ContainerStarted","Data":"03d6eecb307ef6fd08012a2d1085029539943cf73f5c3f1d11d458eb8e186464"}
Jul 08 18:50:14.898580 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.898251    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l" event={"ID":"7c6fb1f1-cfd4-473d-9725-d9956a542299","Type":"ContainerStarted","Data":"189afc24a5fc354807831721135b3cf92a37e322e4d337da23c78af476baa887"}
Jul 08 18:50:14.919239 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.919188    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l" podStartSLOduration=1.919174647 podStartE2EDuration="1.919174647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:50:14.917373522 +0000 UTC m=+2053.953030168" watchObservedRunningTime="2026-07-08 18:50:14.919174647 +0000 UTC m=+2053.954831344"
Jul 08 18:50:14.931242 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:14.931217    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:15.481954 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:15.481920    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e38d66-931b-4824-b3c8-b37ff1846d11" path="/var/lib/kubelet/pods/f9e38d66-931b-4824-b3c8-b37ff1846d11/volumes"
Jul 08 18:50:15.935446 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:15.935420    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:16.906366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:16.906336    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:16.907126 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:16.907110    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:17.033118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:17.033080    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:19.859914 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:19.859876    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:20.791140 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:20.791102    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"]
Jul 08 18:50:20.791333 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:20.791308    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l" podUID="7c6fb1f1-cfd4-473d-9725-d9956a542299" containerName="istio-proxy" containerID="cri-o://03d6eecb307ef6fd08012a2d1085029539943cf73f5c3f1d11d458eb8e186464" gracePeriod=30
Jul 08 18:50:20.823494 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:20.823461    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:20.922397 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:20.922358    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:24.344948 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:24.344907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:25.950295 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:25.950261    2558 generic.go:356] "Generic (PLEG): container finished" podID="7c6fb1f1-cfd4-473d-9725-d9956a542299" containerID="03d6eecb307ef6fd08012a2d1085029539943cf73f5c3f1d11d458eb8e186464" exitCode=0
Jul 08 18:50:25.950649 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:25.950334    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l" event={"ID":"7c6fb1f1-cfd4-473d-9725-d9956a542299","Type":"ContainerDied","Data":"03d6eecb307ef6fd08012a2d1085029539943cf73f5c3f1d11d458eb8e186464"}
Jul 08 18:50:26.044320 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.044253    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:26.090768 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.090687    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-data\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.090768 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.090724    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-token\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.090768 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.090751    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-envoy\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.091118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.090773    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-socket\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.091118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.090812    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-certs\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.091118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.090839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fjwp\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-kube-api-access-8fjwp\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.091118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.090898    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-credential-socket\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.091118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.090942    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c6fb1f1-cfd4-473d-9725-d9956a542299-istiod-ca-cert\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.091118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.091008    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-podinfo\") pod \"7c6fb1f1-cfd4-473d-9725-d9956a542299\" (UID: \"7c6fb1f1-cfd4-473d-9725-d9956a542299\") "
Jul 08 18:50:26.091118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.091073    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:26.091487 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.091300    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:26.091487 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.091355    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-data\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.093094 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.091625    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:26.093094 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.091893    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:26.093094 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.092305    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c6fb1f1-cfd4-473d-9725-d9956a542299-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:50:26.096187 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.093442    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:26.096187 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.093466    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:50:26.099762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.099713    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-kube-api-access-8fjwp" (OuterVolumeSpecName: "kube-api-access-8fjwp") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "kube-api-access-8fjwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:50:26.101197 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.101142    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c6fb1f1-cfd4-473d-9725-d9956a542299" (UID: "7c6fb1f1-cfd4-473d-9725-d9956a542299"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 18:50:26.192069 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.192030    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-podinfo\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.192069 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.192062    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.192069 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.192071    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-istio-envoy\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.192069 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.192080    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.192432 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.192087    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-workload-certs\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.192432 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.192097    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fjwp\" (UniqueName: \"kubernetes.io/projected/7c6fb1f1-cfd4-473d-9725-d9956a542299-kube-api-access-8fjwp\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.192432 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.192107    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c6fb1f1-cfd4-473d-9725-d9956a542299-credential-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.192432 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.192115    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c6fb1f1-cfd4-473d-9725-d9956a542299-istiod-ca-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:26.587114 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.587080    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:26.687950 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.687915    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:26.772198 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.772163    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"]
Jul 08 18:50:26.772564 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.772547    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c6fb1f1-cfd4-473d-9725-d9956a542299" containerName="istio-proxy"
Jul 08 18:50:26.772645 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.772566    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c6fb1f1-cfd4-473d-9725-d9956a542299" containerName="istio-proxy"
Jul 08 18:50:26.772697 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.772667    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c6fb1f1-cfd4-473d-9725-d9956a542299" containerName="istio-proxy"
Jul 08 18:50:26.776665 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.776637    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.779456 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.779435    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-24ff5188-openshift-default-dockercfg-l7jtv\""
Jul 08 18:50:26.790351 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.790328    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"]
Jul 08 18:50:26.796620 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.796599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq5ms\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-kube-api-access-pq5ms\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.796712 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.796641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-envoy\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.796771 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.796728    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-token\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.796828 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.796806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-credential-socket\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.796866 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.796851    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-socket\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.796924 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.796890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-data\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.796924 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.796907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-podinfo\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.797025 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.796945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istiod-ca-cert\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.797025 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.797004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-certs\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.808101 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.808077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:26.897662 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897631    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-token\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.897662 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-credential-socket\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.897889 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897697    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-socket\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.897889 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-data\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.897889 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-podinfo\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.897889 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istiod-ca-cert\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.897889 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897799    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-certs\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.897889 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq5ms\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-kube-api-access-pq5ms\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.897889 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.897863    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-envoy\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.898313 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.898100    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-credential-socket\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.898313 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.898199    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-data\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.898313 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.898234    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-socket\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.898430 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.898306    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-certs\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.898540 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.898519    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istiod-ca-cert\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.900085 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.900065    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-envoy\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.900235 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.900215    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-podinfo\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.905531 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.905509    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-token\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.905620 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.905569    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq5ms\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-kube-api-access-pq5ms\") pod \"e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") " pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:26.911966 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.911943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:26.956064 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.956033    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l" event={"ID":"7c6fb1f1-cfd4-473d-9725-d9956a542299","Type":"ContainerDied","Data":"189afc24a5fc354807831721135b3cf92a37e322e4d337da23c78af476baa887"}
Jul 08 18:50:26.956468 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.956102    2558 scope.go:117] "RemoveContainer" containerID="03d6eecb307ef6fd08012a2d1085029539943cf73f5c3f1d11d458eb8e186464"
Jul 08 18:50:26.956468 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.956049    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"
Jul 08 18:50:26.987751 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.987721    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"]
Jul 08 18:50:26.998558 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:26.998531    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b41ee2bc-openshift-default-59745786bc-l5j7l"]
Jul 08 18:50:27.086928 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.086896    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:27.224263 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.224237    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"]
Jul 08 18:50:27.226182 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:50:27.226131    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cbd2f78_59b3_4499_a5c0_cceb931805b4.slice/crio-3e8e1a2945806afc84e713398f9c5f658cdd00f462f2a1d0e71fad319259bdaa WatchSource:0}: Error finding container 3e8e1a2945806afc84e713398f9c5f658cdd00f462f2a1d0e71fad319259bdaa: Status 404 returned error can't find the container with id 3e8e1a2945806afc84e713398f9c5f658cdd00f462f2a1d0e71fad319259bdaa
Jul 08 18:50:27.228382 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.228352    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:27.228497 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.228413    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:27.228497 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.228443    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:50:27.481132 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.481044    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c6fb1f1-cfd4-473d-9725-d9956a542299" path="/var/lib/kubelet/pods/7c6fb1f1-cfd4-473d-9725-d9956a542299/volumes"
Jul 08 18:50:27.915505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.915465    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:27.962229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.962192    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn" event={"ID":"7cbd2f78-59b3-4499-a5c0-cceb931805b4","Type":"ContainerStarted","Data":"cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25"}
Jul 08 18:50:27.962674 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.962252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn" event={"ID":"7cbd2f78-59b3-4499-a5c0-cceb931805b4","Type":"ContainerStarted","Data":"3e8e1a2945806afc84e713398f9c5f658cdd00f462f2a1d0e71fad319259bdaa"}
Jul 08 18:50:27.984716 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:27.984668    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn" podStartSLOduration=1.984649406 podStartE2EDuration="1.984649406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:50:27.982823733 +0000 UTC m=+2067.018480378" watchObservedRunningTime="2026-07-08 18:50:27.984649406 +0000 UTC m=+2067.020306123"
Jul 08 18:50:28.030659 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.030629    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:28.073430 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.073395    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"]
Jul 08 18:50:28.076907 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.076887    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.079336 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.079316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-24ff5188-serving-cert\""
Jul 08 18:50:28.087167 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.087125    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:28.089382 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.089361    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"]
Jul 08 18:50:28.092804 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.092788    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:28.109377 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.109353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac671b72-92f6-4581-ba8c-216b850b400c-openshift-service-ca\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.109511 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.109483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac671b72-92f6-4581-ba8c-216b850b400c-maas-api-tls\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.109632 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.109533    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5867\" (UniqueName: \"kubernetes.io/projected/ac671b72-92f6-4581-ba8c-216b850b400c-kube-api-access-j5867\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.109632 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.109564    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:28.210505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.210432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac671b72-92f6-4581-ba8c-216b850b400c-maas-api-tls\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.210505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.210466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5867\" (UniqueName: \"kubernetes.io/projected/ac671b72-92f6-4581-ba8c-216b850b400c-kube-api-access-j5867\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.210505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.210500    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac671b72-92f6-4581-ba8c-216b850b400c-openshift-service-ca\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.211058 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.211040    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac671b72-92f6-4581-ba8c-216b850b400c-openshift-service-ca\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.212944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.212920    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac671b72-92f6-4581-ba8c-216b850b400c-maas-api-tls\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.220525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.220503    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5867\" (UniqueName: \"kubernetes.io/projected/ac671b72-92f6-4581-ba8c-216b850b400c-kube-api-access-j5867\") pod \"maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.221508 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.221464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:28.387389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.387360    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:28.517244 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.517224    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"]
Jul 08 18:50:28.519361 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:50:28.519339    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac671b72_92f6_4581_ba8c_216b850b400c.slice/crio-f2bd3d845339106ab39c2bdc82f458a79ecad1c4f3b094c42d7b6ef33b60c272 WatchSource:0}: Error finding container f2bd3d845339106ab39c2bdc82f458a79ecad1c4f3b094c42d7b6ef33b60c272: Status 404 returned error can't find the container with id f2bd3d845339106ab39c2bdc82f458a79ecad1c4f3b094c42d7b6ef33b60c272
Jul 08 18:50:28.538055 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.538033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:28.639162 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.639109    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:28.968749 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.968709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn" event={"ID":"ac671b72-92f6-4581-ba8c-216b850b400c","Type":"ContainerStarted","Data":"f2bd3d845339106ab39c2bdc82f458a79ecad1c4f3b094c42d7b6ef33b60c272"}
Jul 08 18:50:28.969116 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.969030    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:28.969883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:28.969865    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:29.980330 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:29.980294    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn" event={"ID":"ac671b72-92f6-4581-ba8c-216b850b400c","Type":"ContainerStarted","Data":"a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5"}
Jul 08 18:50:29.980732 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:29.980524    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:29.997273 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:29.997228    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn" podStartSLOduration=1.524457744 podStartE2EDuration="1.997214308s" totalImagesPullingTime="472.756564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:50:29.996306812 +0000 UTC m=+2069.031963458" watchObservedRunningTime="2026-07-08 18:50:29.997214308 +0000 UTC m=+2069.032870952"
Jul 08 18:50:30.314129 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:30.314095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:32.297685 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.297651    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"]
Jul 08 18:50:32.298141 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.297883    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn" podUID="ac671b72-92f6-4581-ba8c-216b850b400c" containerName="maas-api" containerID="cri-o://a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5" gracePeriod=30
Jul 08 18:50:32.336172 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.332639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:32.437175 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.435784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:32.510222 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.510192    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"]
Jul 08 18:50:32.510428 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.510405    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn" podUID="7cbd2f78-59b3-4499-a5c0-cceb931805b4" containerName="istio-proxy" containerID="cri-o://cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25" gracePeriod=30
Jul 08 18:50:32.554225 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.552620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:32.584049 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.584026    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:32.651174 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.648522    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:32.657193 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.656435    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac671b72-92f6-4581-ba8c-216b850b400c-maas-api-tls\") pod \"ac671b72-92f6-4581-ba8c-216b850b400c\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") "
Jul 08 18:50:32.657193 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.656565    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac671b72-92f6-4581-ba8c-216b850b400c-openshift-service-ca\") pod \"ac671b72-92f6-4581-ba8c-216b850b400c\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") "
Jul 08 18:50:32.658229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.657548    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac671b72-92f6-4581-ba8c-216b850b400c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac671b72-92f6-4581-ba8c-216b850b400c" (UID: "ac671b72-92f6-4581-ba8c-216b850b400c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:50:32.658229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.657594    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5867\" (UniqueName: \"kubernetes.io/projected/ac671b72-92f6-4581-ba8c-216b850b400c-kube-api-access-j5867\") pod \"ac671b72-92f6-4581-ba8c-216b850b400c\" (UID: \"ac671b72-92f6-4581-ba8c-216b850b400c\") "
Jul 08 18:50:32.658229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.657879    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac671b72-92f6-4581-ba8c-216b850b400c-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:32.660434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.660360    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac671b72-92f6-4581-ba8c-216b850b400c-kube-api-access-j5867" (OuterVolumeSpecName: "kube-api-access-j5867") pod "ac671b72-92f6-4581-ba8c-216b850b400c" (UID: "ac671b72-92f6-4581-ba8c-216b850b400c"). InnerVolumeSpecName "kube-api-access-j5867". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:50:32.660547 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.660457    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac671b72-92f6-4581-ba8c-216b850b400c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac671b72-92f6-4581-ba8c-216b850b400c" (UID: "ac671b72-92f6-4581-ba8c-216b850b400c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:50:32.758744 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.758703    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac671b72-92f6-4581-ba8c-216b850b400c-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:32.758744 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.758735    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5867\" (UniqueName: \"kubernetes.io/projected/ac671b72-92f6-4581-ba8c-216b850b400c-kube-api-access-j5867\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:32.995708 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.995672    2558 generic.go:356] "Generic (PLEG): container finished" podID="ac671b72-92f6-4581-ba8c-216b850b400c" containerID="a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5" exitCode=0
Jul 08 18:50:32.995859 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.995722    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"
Jul 08 18:50:32.995859 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.995752    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn" event={"ID":"ac671b72-92f6-4581-ba8c-216b850b400c","Type":"ContainerDied","Data":"a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5"}
Jul 08 18:50:32.995859 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.995805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn" event={"ID":"ac671b72-92f6-4581-ba8c-216b850b400c","Type":"ContainerDied","Data":"f2bd3d845339106ab39c2bdc82f458a79ecad1c4f3b094c42d7b6ef33b60c272"}
Jul 08 18:50:32.995859 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:32.995827    2558 scope.go:117] "RemoveContainer" containerID="a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5"
Jul 08 18:50:33.004380 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:33.004363    2558 scope.go:117] "RemoveContainer" containerID="a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5"
Jul 08 18:50:33.004607 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:50:33.004587    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5\": container with ID starting with a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5 not found: ID does not exist" containerID="a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5"
Jul 08 18:50:33.004661 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:33.004618    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5"} err="failed to get container status \"a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5\": rpc error: code = NotFound desc = could not find container \"a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5\": container with ID starting with a009303b124b9c3b77a140f67d40f6657d34b1772bd554d04791b5758be892b5 not found: ID does not exist"
Jul 08 18:50:33.019297 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:33.019277    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"]
Jul 08 18:50:33.021988 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:33.021969    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-24ff5188-7bf75d5d75-fbhvn"]
Jul 08 18:50:33.481557 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:33.481527    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac671b72-92f6-4581-ba8c-216b850b400c" path="/var/lib/kubelet/pods/ac671b72-92f6-4581-ba8c-216b850b400c/volumes"
Jul 08 18:50:34.477232 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:34.477190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:38.467688 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.467657    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:38.527126 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.527040    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:38.568651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.568630    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:38.611612 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611538    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq5ms\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-kube-api-access-pq5ms\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611612 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611568    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-socket\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611612 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611589    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-podinfo\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611619    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istiod-ca-cert\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611670    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-credential-socket\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611701    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-certs\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611760    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-envoy\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611804    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-token\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611831    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-data\") pod \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\" (UID: \"7cbd2f78-59b3-4499-a5c0-cceb931805b4\") "
Jul 08 18:50:38.611883 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.611864    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:38.612265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.612070    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:38.612265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.612116    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.612265 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.612236    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:38.612566 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.612475    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:50:38.612984 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.612949    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:38.613970 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.613946    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-kube-api-access-pq5ms" (OuterVolumeSpecName: "kube-api-access-pq5ms") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "kube-api-access-pq5ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:50:38.614076 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.614057    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:50:38.614251 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.614232    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 18:50:38.614306 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.614240    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7cbd2f78-59b3-4499-a5c0-cceb931805b4" (UID: "7cbd2f78-59b3-4499-a5c0-cceb931805b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:50:38.713545 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.713510    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-credential-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.713545 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.713537    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-workload-certs\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.713545 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.713548    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-envoy\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.713769 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.713555    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.713769 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.713564    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-data\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.713769 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.713572    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq5ms\" (UniqueName: \"kubernetes.io/projected/7cbd2f78-59b3-4499-a5c0-cceb931805b4-kube-api-access-pq5ms\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.713769 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.713580    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istio-podinfo\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.713769 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.713587    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cbd2f78-59b3-4499-a5c0-cceb931805b4-istiod-ca-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:50:38.936407 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:38.936370    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:39.026344 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.026307    2558 generic.go:356] "Generic (PLEG): container finished" podID="7cbd2f78-59b3-4499-a5c0-cceb931805b4" containerID="cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25" exitCode=0
Jul 08 18:50:39.026528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.026358    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"
Jul 08 18:50:39.026528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.026390    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn" event={"ID":"7cbd2f78-59b3-4499-a5c0-cceb931805b4","Type":"ContainerDied","Data":"cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25"}
Jul 08 18:50:39.026528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.026449    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn" event={"ID":"7cbd2f78-59b3-4499-a5c0-cceb931805b4","Type":"ContainerDied","Data":"3e8e1a2945806afc84e713398f9c5f658cdd00f462f2a1d0e71fad319259bdaa"}
Jul 08 18:50:39.026528 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.026473    2558 scope.go:117] "RemoveContainer" containerID="cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25"
Jul 08 18:50:39.035327 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.035304    2558 scope.go:117] "RemoveContainer" containerID="cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25"
Jul 08 18:50:39.035591 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:50:39.035573    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25\": container with ID starting with cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25 not found: ID does not exist" containerID="cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25"
Jul 08 18:50:39.035648 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.035600    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25"} err="failed to get container status \"cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25\": rpc error: code = NotFound desc = could not find container \"cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25\": container with ID starting with cd85676c2b409bfec5851faf86b69e486f959fce409f85272db4beab76df4c25 not found: ID does not exist"
Jul 08 18:50:39.072941 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.072911    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"]
Jul 08 18:50:39.085973 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.085948    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:39.086380 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.086360    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-24ff5188-openshift-default-678c5d7867-zvggn"]
Jul 08 18:50:39.166824 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.166791    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:39.481603 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:39.481568    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cbd2f78-59b3-4499-a5c0-cceb931805b4" path="/var/lib/kubelet/pods/7cbd2f78-59b3-4499-a5c0-cceb931805b4/volumes"
Jul 08 18:50:40.531850 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:40.531812    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:46.205370 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:46.205336    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:46.263022 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:46.262989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:46.375977 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:46.375942    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:46.530126 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:46.530031    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:50:46.960832 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:50:46.960804    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:12.964446 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:12.964375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:19.026599 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:19.026562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:19.089457 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:19.089422    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:19.156886 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:19.156829    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:19.255983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:19.255942    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:29.832506 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:29.832470    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:35.126452 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:35.126411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:40.788091 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:40.788050    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:40.854452 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:40.854403    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:40.930121 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:40.930091    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:41.028964 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:41.028925    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:51.541656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:51.541616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:52.391123 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:52.391082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:58.226250 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:58.226138    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:58.284845 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:58.284809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:58.365423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:58.365364    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:58.463163 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:58.463120    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:58.562810 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:58.562710    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:59.335412 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:59.335378    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:59.435964 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:59.435934    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:51:59.535705 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:51:59.535668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:01.176476 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:01.176431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:06.974118 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:06.974081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:07.075058 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:07.075022    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:07.650402 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:07.650367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:13.492568 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:13.492524    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:13.592460 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:13.592422    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:13.722965 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:13.722932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:14.019890 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.019858    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"]
Jul 08 18:52:14.020223 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.020209    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac671b72-92f6-4581-ba8c-216b850b400c" containerName="maas-api"
Jul 08 18:52:14.020277 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.020224    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac671b72-92f6-4581-ba8c-216b850b400c" containerName="maas-api"
Jul 08 18:52:14.020277 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.020238    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbd2f78-59b3-4499-a5c0-cceb931805b4" containerName="istio-proxy"
Jul 08 18:52:14.020277 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.020244    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbd2f78-59b3-4499-a5c0-cceb931805b4" containerName="istio-proxy"
Jul 08 18:52:14.020376 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.020296    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cbd2f78-59b3-4499-a5c0-cceb931805b4" containerName="istio-proxy"
Jul 08 18:52:14.020376 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.020306    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac671b72-92f6-4581-ba8c-216b850b400c" containerName="maas-api"
Jul 08 18:52:14.023093 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.023076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.025620 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.025598    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-13d4aaa8-openshift-default-dockercfg-6bmhj\""
Jul 08 18:52:14.043113 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.043089    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"]
Jul 08 18:52:14.046240 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.046213    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:14.155345 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.155310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:14.208622 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-envoy\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.208815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-socket\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.208815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-certs\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.208815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-data\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.208815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9mf4\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-kube-api-access-j9mf4\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.208815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-credential-socket\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.209034 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208868    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ebabffe-4ca9-465d-8353-16dced918e9b-istiod-ca-cert\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.209034 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-token\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.209034 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.208910    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-podinfo\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310388 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-credential-socket\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310388 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ebabffe-4ca9-465d-8353-16dced918e9b-istiod-ca-cert\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310388 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-token\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-podinfo\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-envoy\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310463    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-socket\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-certs\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310656 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-data\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310787    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-credential-socket\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.310944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310921    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-socket\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.311058 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310959    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-certs\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.311058 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.310985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9mf4\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-kube-api-access-j9mf4\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.311058 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.311040    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-data\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.311251 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.311232    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ebabffe-4ca9-465d-8353-16dced918e9b-istiod-ca-cert\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.312821 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.312798    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-envoy\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.312929 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.312903    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-podinfo\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.325716 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.325685    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9mf4\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-kube-api-access-j9mf4\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.325860 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.325814    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-token\") pod \"e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") " pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.333782 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.333754    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:14.469366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.469343    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"]
Jul 08 18:52:14.471244 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:52:14.471217    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebabffe_4ca9_465d_8353_16dced918e9b.slice/crio-27fc4410f18411727a8a2d604715b889d8cd020e2ff87f75e9f62f5334182c36 WatchSource:0}: Error finding container 27fc4410f18411727a8a2d604715b889d8cd020e2ff87f75e9f62f5334182c36: Status 404 returned error can't find the container with id 27fc4410f18411727a8a2d604715b889d8cd020e2ff87f75e9f62f5334182c36
Jul 08 18:52:14.473374 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.473343    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:14.473449 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.473407    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:14.473449 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:14.473436    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:15.453907 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:15.453872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" event={"ID":"4ebabffe-4ca9-465d-8353-16dced918e9b","Type":"ContainerStarted","Data":"ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf"}
Jul 08 18:52:15.454373 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:15.453922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" event={"ID":"4ebabffe-4ca9-465d-8353-16dced918e9b","Type":"ContainerStarted","Data":"27fc4410f18411727a8a2d604715b889d8cd020e2ff87f75e9f62f5334182c36"}
Jul 08 18:52:15.475256 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:15.475204    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" podStartSLOduration=1.475188836 podStartE2EDuration="1.475188836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:52:15.473332585 +0000 UTC m=+2174.508989230" watchObservedRunningTime="2026-07-08 18:52:15.475188836 +0000 UTC m=+2174.510845482"
Jul 08 18:52:16.334483 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:16.334449    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:16.339286 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:16.339261    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:16.458659 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:16.458621    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:16.459577 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:16.459556    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:17.371389 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.371344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:17.470367 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.470339    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:17.545631 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.545599    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"]
Jul 08 18:52:17.549405 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.549386    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.551930 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.551908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-13d4aaa8-serving-cert\""
Jul 08 18:52:17.560304 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.560281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"]
Jul 08 18:52:17.586636 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.586607    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:17.640423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.640394    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fnl4\" (UniqueName: \"kubernetes.io/projected/ed76463a-87ca-4ea4-9d99-f686e83688c6-kube-api-access-5fnl4\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.640570 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.640435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed76463a-87ca-4ea4-9d99-f686e83688c6-openshift-service-ca\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.640570 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.640498    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.741535 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.741495    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fnl4\" (UniqueName: \"kubernetes.io/projected/ed76463a-87ca-4ea4-9d99-f686e83688c6-kube-api-access-5fnl4\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.741535 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.741541    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed76463a-87ca-4ea4-9d99-f686e83688c6-openshift-service-ca\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.741766 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.741606    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.741766 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:52:17.741721    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-serving-cert: secret "maas-api-e2e-mt-13d4aaa8-serving-cert" not found
Jul 08 18:52:17.741830 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:52:17.741793    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls podName:ed76463a-87ca-4ea4-9d99-f686e83688c6 nodeName:}" failed. No retries permitted until 2026-07-08 18:52:18.24177825 +0000 UTC m=+2177.277434878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls") pod "maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh" (UID: "ed76463a-87ca-4ea4-9d99-f686e83688c6") : secret "maas-api-e2e-mt-13d4aaa8-serving-cert" not found
Jul 08 18:52:17.742322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.742303    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed76463a-87ca-4ea4-9d99-f686e83688c6-openshift-service-ca\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.755000 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.754980    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fnl4\" (UniqueName: \"kubernetes.io/projected/ed76463a-87ca-4ea4-9d99-f686e83688c6-kube-api-access-5fnl4\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:17.848625 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:17.848594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:18.133516 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:18.133463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:18.233877 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:18.233839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:18.245846 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:18.245812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:18.248224 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:18.248199    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls\") pod \"maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:18.461478 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:18.461389    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:18.602706 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:18.602672    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"]
Jul 08 18:52:18.605546 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:52:18.605514    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded76463a_87ca_4ea4_9d99_f686e83688c6.slice/crio-a916dc6b28eeeebff556d8bda753864bff41104223aac14fc6ed3971c120c998 WatchSource:0}: Error finding container a916dc6b28eeeebff556d8bda753864bff41104223aac14fc6ed3971c120c998: Status 404 returned error can't find the container with id a916dc6b28eeeebff556d8bda753864bff41104223aac14fc6ed3971c120c998
Jul 08 18:52:19.486040 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:19.485997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh" event={"ID":"ed76463a-87ca-4ea4-9d99-f686e83688c6","Type":"ContainerStarted","Data":"e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f"}
Jul 08 18:52:19.486239 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:19.486065    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh" event={"ID":"ed76463a-87ca-4ea4-9d99-f686e83688c6","Type":"ContainerStarted","Data":"a916dc6b28eeeebff556d8bda753864bff41104223aac14fc6ed3971c120c998"}
Jul 08 18:52:19.486239 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:19.486093    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:19.496752 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:19.496701    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh" podStartSLOduration=1.994944507 podStartE2EDuration="2.496684064s" totalImagesPullingTime="501.739557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:52:19.495776191 +0000 UTC m=+2178.531432856" watchObservedRunningTime="2026-07-08 18:52:19.496684064 +0000 UTC m=+2178.532340709"
Jul 08 18:52:21.888298 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:21.888264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:22.548345 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:22.548297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:22.648309 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:22.648267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:22.983332 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:22.983301    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:25.489110 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:25.489081    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:28.787711 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:28.787672    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:28.887834 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:28.887797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:29.222830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.222803    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"]
Jul 08 18:52:29.223023 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.222998    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh" podUID="ed76463a-87ca-4ea4-9d99-f686e83688c6" containerName="maas-api" containerID="cri-o://e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f" gracePeriod=30
Jul 08 18:52:29.268296 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.268264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:29.362713 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.362670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:29.474895 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.474834    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:29.517751 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.517717    2558 generic.go:356] "Generic (PLEG): container finished" podID="ed76463a-87ca-4ea4-9d99-f686e83688c6" containerID="e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f" exitCode=0
Jul 08 18:52:29.517944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.517772    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"
Jul 08 18:52:29.517944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.517809    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh" event={"ID":"ed76463a-87ca-4ea4-9d99-f686e83688c6","Type":"ContainerDied","Data":"e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f"}
Jul 08 18:52:29.517944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.517884    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh" event={"ID":"ed76463a-87ca-4ea4-9d99-f686e83688c6","Type":"ContainerDied","Data":"a916dc6b28eeeebff556d8bda753864bff41104223aac14fc6ed3971c120c998"}
Jul 08 18:52:29.517944 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.517918    2558 scope.go:117] "RemoveContainer" containerID="e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f"
Jul 08 18:52:29.526200 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.526176    2558 scope.go:117] "RemoveContainer" containerID="e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f"
Jul 08 18:52:29.526490 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:52:29.526462    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f\": container with ID starting with e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f not found: ID does not exist" containerID="e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f"
Jul 08 18:52:29.526621 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.526500    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f"} err="failed to get container status \"e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f\": rpc error: code = NotFound desc = could not find container \"e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f\": container with ID starting with e601867990b6d28d75eff16f1017ea81abb011f585a3323302deb443b98cf32f not found: ID does not exist"
Jul 08 18:52:29.542826 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.542794    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fnl4\" (UniqueName: \"kubernetes.io/projected/ed76463a-87ca-4ea4-9d99-f686e83688c6-kube-api-access-5fnl4\") pod \"ed76463a-87ca-4ea4-9d99-f686e83688c6\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") "
Jul 08 18:52:29.542983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.542881    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls\") pod \"ed76463a-87ca-4ea4-9d99-f686e83688c6\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") "
Jul 08 18:52:29.542983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.542931    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed76463a-87ca-4ea4-9d99-f686e83688c6-openshift-service-ca\") pod \"ed76463a-87ca-4ea4-9d99-f686e83688c6\" (UID: \"ed76463a-87ca-4ea4-9d99-f686e83688c6\") "
Jul 08 18:52:29.543314 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.543292    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed76463a-87ca-4ea4-9d99-f686e83688c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed76463a-87ca-4ea4-9d99-f686e83688c6" (UID: "ed76463a-87ca-4ea4-9d99-f686e83688c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:52:29.544878 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.544843    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed76463a-87ca-4ea4-9d99-f686e83688c6" (UID: "ed76463a-87ca-4ea4-9d99-f686e83688c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:52:29.545000 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.544890    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed76463a-87ca-4ea4-9d99-f686e83688c6-kube-api-access-5fnl4" (OuterVolumeSpecName: "kube-api-access-5fnl4") pod "ed76463a-87ca-4ea4-9d99-f686e83688c6" (UID: "ed76463a-87ca-4ea4-9d99-f686e83688c6"). InnerVolumeSpecName "kube-api-access-5fnl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:52:29.644322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.644283    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed76463a-87ca-4ea4-9d99-f686e83688c6-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:29.644322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.644312    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed76463a-87ca-4ea4-9d99-f686e83688c6-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:29.644322 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.644323    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fnl4\" (UniqueName: \"kubernetes.io/projected/ed76463a-87ca-4ea4-9d99-f686e83688c6-kube-api-access-5fnl4\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:29.658854 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.658809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:29.842042 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.842001    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"]
Jul 08 18:52:29.844505 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:29.844482    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-13d4aaa8-5fd47c9cb4-xg4mh"]
Jul 08 18:52:31.483468 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:31.483421    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed76463a-87ca-4ea4-9d99-f686e83688c6" path="/var/lib/kubelet/pods/ed76463a-87ca-4ea4-9d99-f686e83688c6/volumes"
Jul 08 18:52:31.680378 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:31.679902    2558 patch_prober.go:28] interesting pod/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:49126->10.132.0.38:15021: read: connection reset by peer" start-of-body=
Jul 08 18:52:31.680378 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:31.679958    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:49126->10.132.0.38:15021: read: connection reset by peer"
Jul 08 18:52:32.535161 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:32.535122    2558 generic.go:356] "Generic (PLEG): container finished" podID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerID="ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf" exitCode=0
Jul 08 18:52:32.535537 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:32.535196    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" event={"ID":"4ebabffe-4ca9-465d-8353-16dced918e9b","Type":"ContainerDied","Data":"ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf"}
Jul 08 18:52:32.535618 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:32.535603    2558 scope.go:117] "RemoveContainer" containerID="ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf"
Jul 08 18:52:32.536578 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:32.536547    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:32.536701 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:32.536615    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:32.536701 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:32.536644    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:33.541691 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:33.541657    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" event={"ID":"4ebabffe-4ca9-465d-8353-16dced918e9b","Type":"ContainerStarted","Data":"cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f"}
Jul 08 18:52:34.334116 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:34.334085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:34.337938 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:34.337912    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:34.546042 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:34.546012    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:34.547061 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:34.547043    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:35.490445 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:35.490408    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:35.591012 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:35.590976    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:35.754517 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:35.754423    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"]
Jul 08 18:52:35.771770 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:35.771735    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:36.100795 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:36.100701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:36.204059 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:36.204021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:36.339943 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:36.339908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:36.555325 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:36.555295    2558 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" secret="" err="secret \"e2e-mt-13d4aaa8-openshift-default-dockercfg-6bmhj\" not found"
Jul 08 18:52:37.559851 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:37.559808    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerName="istio-proxy" containerID="cri-o://cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f" gracePeriod=30
Jul 08 18:52:42.071219 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.071177    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:42.178418 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.178383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:42.271098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.271068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:42.431683 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.431644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:42.810315 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.810288    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:42.863260 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863228    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-socket\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863273    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-envoy\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863290    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-credential-socket\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863314    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-data\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863348    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-podinfo\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863368    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-certs\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863393    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9mf4\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-kube-api-access-j9mf4\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863423 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863409    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-token\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863449    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ebabffe-4ca9-465d-8353-16dced918e9b-istiod-ca-cert\") pod \"4ebabffe-4ca9-465d-8353-16dced918e9b\" (UID: \"4ebabffe-4ca9-465d-8353-16dced918e9b\") "
Jul 08 18:52:42.863790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863561    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:52:42.863790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863623    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:52:42.863790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863733    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:52:42.863999 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863821    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:42.863999 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.863842    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-credential-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:42.864459 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.864431    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ebabffe-4ca9-465d-8353-16dced918e9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:52:42.864611 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.864548    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:52:42.865561 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.865527    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:52:42.865671 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.865610    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 18:52:42.865671 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.865622    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-kube-api-access-j9mf4" (OuterVolumeSpecName: "kube-api-access-j9mf4") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "kube-api-access-j9mf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:52:42.865671 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.865661    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ebabffe-4ca9-465d-8353-16dced918e9b" (UID: "4ebabffe-4ca9-465d-8353-16dced918e9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:52:42.964931 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.964881    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-podinfo\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:42.964931 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.964921    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-workload-certs\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:42.964931 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.964935    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9mf4\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-kube-api-access-j9mf4\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:42.965229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.964949    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:42.965229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.964963    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ebabffe-4ca9-465d-8353-16dced918e9b-istiod-ca-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:42.965229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.964974    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-envoy\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:42.965229 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:42.964984    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ebabffe-4ca9-465d-8353-16dced918e9b-istio-data\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:52:43.587433 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.587403    2558 generic.go:356] "Generic (PLEG): container finished" podID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerID="cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f" exitCode=0
Jul 08 18:52:43.587805 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.587450    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"
Jul 08 18:52:43.587805 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.587485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" event={"ID":"4ebabffe-4ca9-465d-8353-16dced918e9b","Type":"ContainerDied","Data":"cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f"}
Jul 08 18:52:43.587805 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.587535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h" event={"ID":"4ebabffe-4ca9-465d-8353-16dced918e9b","Type":"ContainerDied","Data":"27fc4410f18411727a8a2d604715b889d8cd020e2ff87f75e9f62f5334182c36"}
Jul 08 18:52:43.587805 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.587558    2558 scope.go:117] "RemoveContainer" containerID="cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f"
Jul 08 18:52:43.599244 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.599226    2558 scope.go:117] "RemoveContainer" containerID="ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf"
Jul 08 18:52:43.605136 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.605115    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"]
Jul 08 18:52:43.607878 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.607862    2558 scope.go:117] "RemoveContainer" containerID="cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f"
Jul 08 18:52:43.608031 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.608012    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-13d4aaa8-openshift-default-7cf9d4d867-tq95h"]
Jul 08 18:52:43.608132 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:52:43.608116    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f\": container with ID starting with cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f not found: ID does not exist" containerID="cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f"
Jul 08 18:52:43.608208 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.608140    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f"} err="failed to get container status \"cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f\": rpc error: code = NotFound desc = could not find container \"cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f\": container with ID starting with cc0bb77d526b1063a76aa31366b5bd616398aa9ef091e1e8c0eedb8daf32445f not found: ID does not exist"
Jul 08 18:52:43.608208 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.608174    2558 scope.go:117] "RemoveContainer" containerID="ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf"
Jul 08 18:52:43.608420 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:52:43.608402    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf\": container with ID starting with ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf not found: ID does not exist" containerID="ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf"
Jul 08 18:52:43.608472 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:43.608425    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf"} err="failed to get container status \"ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf\": rpc error: code = NotFound desc = could not find container \"ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf\": container with ID starting with ea9a2be52397230222ba5f6c6bd8b3f667a436f88c35e69daec77edcc34f6cdf not found: ID does not exist"
Jul 08 18:52:45.481098 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:45.481061    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" path="/var/lib/kubelet/pods/4ebabffe-4ca9-465d-8353-16dced918e9b/volumes"
Jul 08 18:52:48.035762 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:48.035719    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:48.095744 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:48.095714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:54.895997 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:54.895960    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:55.177402 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.177314    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"]
Jul 08 18:52:55.177746 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.177728    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed76463a-87ca-4ea4-9d99-f686e83688c6" containerName="maas-api"
Jul 08 18:52:55.177830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.177749    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed76463a-87ca-4ea4-9d99-f686e83688c6" containerName="maas-api"
Jul 08 18:52:55.177830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.177784    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerName="istio-proxy"
Jul 08 18:52:55.177830 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.177792    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerName="istio-proxy"
Jul 08 18:52:55.177982 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.177876    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerName="istio-proxy"
Jul 08 18:52:55.177982 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.177889    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerName="istio-proxy"
Jul 08 18:52:55.177982 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.177899    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed76463a-87ca-4ea4-9d99-f686e83688c6" containerName="maas-api"
Jul 08 18:52:55.182677 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.182652    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.185353 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.185326    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2046dd63-openshift-default-dockercfg-q67pt\""
Jul 08 18:52:55.192618 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.192593    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"]
Jul 08 18:52:55.218048 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.218021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:55.272132 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-socket\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.272132 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3521721-4334-49ea-a200-82af15c1f3ab-istio-podinfo\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.272408 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-certs\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.272408 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67pj\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-kube-api-access-b67pj\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.272408 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-data\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.272408 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-credential-socket\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.272408 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-istio-token\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.272632 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272415    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3521721-4334-49ea-a200-82af15c1f3ab-istiod-ca-cert\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.272632 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.272529    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-envoy\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.319054 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.319024    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:55.373434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-envoy\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.373434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-socket\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.373702 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3521721-4334-49ea-a200-82af15c1f3ab-istio-podinfo\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.373702 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373506    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-certs\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.373702 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67pj\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-kube-api-access-b67pj\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.373702 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-data\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.373702 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-credential-socket\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.373702 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373646    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-istio-token\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.373702 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3521721-4334-49ea-a200-82af15c1f3ab-istiod-ca-cert\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.374086 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.373943    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-certs\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.374255 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.374227    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-data\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.374435 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.374411    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3521721-4334-49ea-a200-82af15c1f3ab-istiod-ca-cert\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.374734 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.374527    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-credential-socket\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.374847 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.374653    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-socket\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.376312 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.376293    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3521721-4334-49ea-a200-82af15c1f3ab-istio-podinfo\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.376625 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.376606    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-envoy\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.382262 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.382238    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-istio-token\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.382380 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.382236    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67pj\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-kube-api-access-b67pj\") pod \"e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") " pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.493059 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.492982    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:55.627424 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.627400    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"]
Jul 08 18:52:55.629687 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:52:55.629659    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3521721_4334_49ea_a200_82af15c1f3ab.slice/crio-5daa438fc2f7537854fe7d33d424f6342cd445b23daf9bf7cb71e148ff736979 WatchSource:0}: Error finding container 5daa438fc2f7537854fe7d33d424f6342cd445b23daf9bf7cb71e148ff736979: Status 404 returned error can't find the container with id 5daa438fc2f7537854fe7d33d424f6342cd445b23daf9bf7cb71e148ff736979
Jul 08 18:52:55.631863 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.631833    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:55.631948 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.631900    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:55.631948 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.631929    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:52:55.642135 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:55.642112    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" event={"ID":"b3521721-4334-49ea-a200-82af15c1f3ab","Type":"ContainerStarted","Data":"5daa438fc2f7537854fe7d33d424f6342cd445b23daf9bf7cb71e148ff736979"}
Jul 08 18:52:56.647899 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:56.647858    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" event={"ID":"b3521721-4334-49ea-a200-82af15c1f3ab","Type":"ContainerStarted","Data":"200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a"}
Jul 08 18:52:56.668062 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:56.668009    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" podStartSLOduration=1.667989768 podStartE2EDuration="1.667989768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:52:56.66697329 +0000 UTC m=+2215.702629949" watchObservedRunningTime="2026-07-08 18:52:56.667989768 +0000 UTC m=+2215.703646414"
Jul 08 18:52:57.493167 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:57.493111    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:57.498417 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:57.498392    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:57.652708 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:57.652677    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:57.653631 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:57.653614    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:52:58.566718 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.566678    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:58.674293 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.674262    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:58.832177 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.832076    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"]
Jul 08 18:52:58.832531 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.832514    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerName="istio-proxy"
Jul 08 18:52:58.832616 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.832534    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ebabffe-4ca9-465d-8353-16dced918e9b" containerName="istio-proxy"
Jul 08 18:52:58.835651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.835630    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:58.837982 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.837962    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2046dd63-serving-cert\""
Jul 08 18:52:58.846693 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.846671    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"]
Jul 08 18:52:58.864222 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:58.864193    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:59.014804 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.014760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.014983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.014829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8a18fb9-4a97-478f-a42b-aee3ac468775-openshift-service-ca\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.014983 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.014889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj52f\" (UniqueName: \"kubernetes.io/projected/d8a18fb9-4a97-478f-a42b-aee3ac468775-kube-api-access-gj52f\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.115870 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.115767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.115870 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.115868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8a18fb9-4a97-478f-a42b-aee3ac468775-openshift-service-ca\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.116073 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.115929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj52f\" (UniqueName: \"kubernetes.io/projected/d8a18fb9-4a97-478f-a42b-aee3ac468775-kube-api-access-gj52f\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.116073 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:52:59.115958    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-serving-cert: secret "maas-api-e2e-mt-2046dd63-serving-cert" not found
Jul 08 18:52:59.116073 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:52:59.116044    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls podName:d8a18fb9-4a97-478f-a42b-aee3ac468775 nodeName:}" failed. No retries permitted until 2026-07-08 18:52:59.616019867 +0000 UTC m=+2218.651676510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls") pod "maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2" (UID: "d8a18fb9-4a97-478f-a42b-aee3ac468775") : secret "maas-api-e2e-mt-2046dd63-serving-cert" not found
Jul 08 18:52:59.116617 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.116596    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8a18fb9-4a97-478f-a42b-aee3ac468775-openshift-service-ca\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.129512 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.129476    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj52f\" (UniqueName: \"kubernetes.io/projected/d8a18fb9-4a97-478f-a42b-aee3ac468775-kube-api-access-gj52f\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.284039 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.283997    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:59.384578 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.384545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:59.486135 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.486094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:52:59.621330 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.621287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.623715 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.623686    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls\") pod \"maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.747105 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.747013    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:52:59.879929 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:52:59.879901    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"]
Jul 08 18:52:59.882299 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:52:59.882264    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a18fb9_4a97_478f_a42b_aee3ac468775.slice/crio-42df76b0e091b45ea4054903474ac8eeab3603bc8c9a050844d1db45144ad680 WatchSource:0}: Error finding container 42df76b0e091b45ea4054903474ac8eeab3603bc8c9a050844d1db45144ad680: Status 404 returned error can't find the container with id 42df76b0e091b45ea4054903474ac8eeab3603bc8c9a050844d1db45144ad680
Jul 08 18:53:00.668708 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:00.668675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2" event={"ID":"d8a18fb9-4a97-478f-a42b-aee3ac468775","Type":"ContainerStarted","Data":"52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d"}
Jul 08 18:53:00.668900 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:00.668723    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2" event={"ID":"d8a18fb9-4a97-478f-a42b-aee3ac468775","Type":"ContainerStarted","Data":"42df76b0e091b45ea4054903474ac8eeab3603bc8c9a050844d1db45144ad680"}
Jul 08 18:53:00.668900 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:00.668781    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:53:00.685612 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:00.685562    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2" podStartSLOduration=2.320859919 podStartE2EDuration="2.68554434s" totalImagesPullingTime="364.684421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:53:00.685012641 +0000 UTC m=+2219.720669286" watchObservedRunningTime="2026-07-08 18:53:00.68554434 +0000 UTC m=+2219.721200988"
Jul 08 18:53:03.060130 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:03.060087    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:06.678651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:06.678623    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:53:13.007086 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:13.007045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:13.694355 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:13.694309    2558 patch_prober.go:28] interesting pod/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 18:53:13.694539 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:13.694388    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 18:53:14.738099 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:14.738070    2558 generic.go:356] "Generic (PLEG): container finished" podID="b3521721-4334-49ea-a200-82af15c1f3ab" containerID="200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a" exitCode=0
Jul 08 18:53:14.738534 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:14.738160    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" event={"ID":"b3521721-4334-49ea-a200-82af15c1f3ab","Type":"ContainerDied","Data":"200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a"}
Jul 08 18:53:14.738534 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:14.738531    2558 scope.go:117] "RemoveContainer" containerID="200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a"
Jul 08 18:53:14.739684 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:14.739650    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:53:14.739787 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:14.739727    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:53:14.739787 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:14.739760    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:53:15.747752 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:15.747715    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" event={"ID":"b3521721-4334-49ea-a200-82af15c1f3ab","Type":"ContainerStarted","Data":"e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234"}
Jul 08 18:53:16.493236 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:16.493197    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:53:16.493448 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:16.493401    2558 patch_prober.go:28] interesting pod/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 08 18:53:16.493526 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:16.493452    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 08 18:53:17.493919 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:17.493883    2558 patch_prober.go:28] interesting pod/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 08 18:53:17.494324 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:17.493944    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 08 18:53:18.494085 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:18.494049    2558 patch_prober.go:28] interesting pod/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 08 18:53:18.494490 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:18.494100    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 08 18:53:19.494077 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:19.494044    2558 patch_prober.go:28] interesting pod/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 08 18:53:19.494268 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:19.494097    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 08 18:53:20.497318 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:20.497283    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:53:20.497712 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:20.497523    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:53:20.498141 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:20.498126    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:53:45.612109 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.612071    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"]
Jul 08 18:53:45.612733 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.612348    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2" podUID="d8a18fb9-4a97-478f-a42b-aee3ac468775" containerName="maas-api" containerID="cri-o://52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d" gracePeriod=30
Jul 08 18:53:45.639812 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.639767    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:45.740950 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.740910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:45.860267 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.860242    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:53:45.902197 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.902139    2558 generic.go:356] "Generic (PLEG): container finished" podID="d8a18fb9-4a97-478f-a42b-aee3ac468775" containerID="52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d" exitCode=0
Jul 08 18:53:45.902381 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.902203    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"
Jul 08 18:53:45.902381 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.902228    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2" event={"ID":"d8a18fb9-4a97-478f-a42b-aee3ac468775","Type":"ContainerDied","Data":"52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d"}
Jul 08 18:53:45.902381 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.902295    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2" event={"ID":"d8a18fb9-4a97-478f-a42b-aee3ac468775","Type":"ContainerDied","Data":"42df76b0e091b45ea4054903474ac8eeab3603bc8c9a050844d1db45144ad680"}
Jul 08 18:53:45.902381 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.902327    2558 scope.go:117] "RemoveContainer" containerID="52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d"
Jul 08 18:53:45.910665 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.910649    2558 scope.go:117] "RemoveContainer" containerID="52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d"
Jul 08 18:53:45.910923 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:53:45.910901    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d\": container with ID starting with 52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d not found: ID does not exist" containerID="52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d"
Jul 08 18:53:45.910968 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:45.910932    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d"} err="failed to get container status \"52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d\": rpc error: code = NotFound desc = could not find container \"52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d\": container with ID starting with 52d622d0494b12405f707988d2b30256cfcd3d089447229d8cc247569627db7d not found: ID does not exist"
Jul 08 18:53:46.052488 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.052455    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8a18fb9-4a97-478f-a42b-aee3ac468775-openshift-service-ca\") pod \"d8a18fb9-4a97-478f-a42b-aee3ac468775\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") "
Jul 08 18:53:46.052488 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.052498    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj52f\" (UniqueName: \"kubernetes.io/projected/d8a18fb9-4a97-478f-a42b-aee3ac468775-kube-api-access-gj52f\") pod \"d8a18fb9-4a97-478f-a42b-aee3ac468775\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") "
Jul 08 18:53:46.052731 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.052543    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls\") pod \"d8a18fb9-4a97-478f-a42b-aee3ac468775\" (UID: \"d8a18fb9-4a97-478f-a42b-aee3ac468775\") "
Jul 08 18:53:46.052890 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.052864    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8a18fb9-4a97-478f-a42b-aee3ac468775-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d8a18fb9-4a97-478f-a42b-aee3ac468775" (UID: "d8a18fb9-4a97-478f-a42b-aee3ac468775"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:53:46.054647 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.054624    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d8a18fb9-4a97-478f-a42b-aee3ac468775" (UID: "d8a18fb9-4a97-478f-a42b-aee3ac468775"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:53:46.054763 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.054675    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a18fb9-4a97-478f-a42b-aee3ac468775-kube-api-access-gj52f" (OuterVolumeSpecName: "kube-api-access-gj52f") pod "d8a18fb9-4a97-478f-a42b-aee3ac468775" (UID: "d8a18fb9-4a97-478f-a42b-aee3ac468775"). InnerVolumeSpecName "kube-api-access-gj52f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:53:46.153506 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.153360    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8a18fb9-4a97-478f-a42b-aee3ac468775-openshift-service-ca\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:53:46.153506 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.153395    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj52f\" (UniqueName: \"kubernetes.io/projected/d8a18fb9-4a97-478f-a42b-aee3ac468775-kube-api-access-gj52f\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:53:46.153506 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.153411    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8a18fb9-4a97-478f-a42b-aee3ac468775-maas-api-tls\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:53:46.222982 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.222948    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"]
Jul 08 18:53:46.226569 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.226540    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2046dd63-7fb9dcd7fb-npsr2"]
Jul 08 18:53:46.693815 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:46.693775    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:53:47.482114 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:47.482079    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8a18fb9-4a97-478f-a42b-aee3ac468775" path="/var/lib/kubelet/pods/d8a18fb9-4a97-478f-a42b-aee3ac468775/volumes"
Jul 08 18:53:51.736238 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:53:51.736191    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:28.252651 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:28.252611    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:28.525358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:28.525276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:34.090733 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:34.090690    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:48.485094 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:48.485057    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:48.551426 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:48.551389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:48.773026 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:48.772950    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"]
Jul 08 18:54:48.773197 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:48.773174    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy" containerID="cri-o://e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234" gracePeriod=30
Jul 08 18:54:48.802628 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:48.802593    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:50.500351 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:50.500310    2558 patch_prober.go:28] interesting pod/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 18:54:50.500718 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:50.500378    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 18:54:50.622838 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:50.622805    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:50.726013 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:50.725976    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:51.135709 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:51.135655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:51.233341 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:51.233298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:51.333709 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:51.333675    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:52.750285 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:52.750243    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:54.040095 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.040025    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:54:54.146295 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146265    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-data\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146295 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146300    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-certs\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146521 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146361    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-credential-socket\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146521 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146388    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3521721-4334-49ea-a200-82af15c1f3ab-istiod-ca-cert\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146521 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146451    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b67pj\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-kube-api-access-b67pj\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146521 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146479    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-istio-token\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146521 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146514    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-envoy\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146545    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-socket\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146568    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3521721-4334-49ea-a200-82af15c1f3ab-istio-podinfo\") pod \"b3521721-4334-49ea-a200-82af15c1f3ab\" (UID: \"b3521721-4334-49ea-a200-82af15c1f3ab\") "
Jul 08 18:54:54.146790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146617    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:54:54.146790 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146634    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:54:54.146981 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146796    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:54:54.146981 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146854    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-certs\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:54.146981 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146871    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-credential-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:54.146981 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.146867    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3521721-4334-49ea-a200-82af15c1f3ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:54:54.147255 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.147231    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:54:54.148614 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.148585    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:54:54.148730 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.148642    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:54:54.148771 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.148728    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3521721-4334-49ea-a200-82af15c1f3ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 18:54:54.148771 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.148746    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-kube-api-access-b67pj" (OuterVolumeSpecName: "kube-api-access-b67pj") pod "b3521721-4334-49ea-a200-82af15c1f3ab" (UID: "b3521721-4334-49ea-a200-82af15c1f3ab"). InnerVolumeSpecName "kube-api-access-b67pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:54:54.205723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.205690    2558 generic.go:356] "Generic (PLEG): container finished" podID="b3521721-4334-49ea-a200-82af15c1f3ab" containerID="e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234" exitCode=0
Jul 08 18:54:54.205901 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.205749    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"
Jul 08 18:54:54.205901 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.205770    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" event={"ID":"b3521721-4334-49ea-a200-82af15c1f3ab","Type":"ContainerDied","Data":"e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234"}
Jul 08 18:54:54.205901 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.205824    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w" event={"ID":"b3521721-4334-49ea-a200-82af15c1f3ab","Type":"ContainerDied","Data":"5daa438fc2f7537854fe7d33d424f6342cd445b23daf9bf7cb71e148ff736979"}
Jul 08 18:54:54.205901 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.205845    2558 scope.go:117] "RemoveContainer" containerID="e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234"
Jul 08 18:54:54.214584 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.214565    2558 scope.go:117] "RemoveContainer" containerID="200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a"
Jul 08 18:54:54.223744 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.223728    2558 scope.go:117] "RemoveContainer" containerID="e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234"
Jul 08 18:54:54.223978 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:54:54.223962    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234\": container with ID starting with e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234 not found: ID does not exist" containerID="e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234"
Jul 08 18:54:54.224035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.223986    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234"} err="failed to get container status \"e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234\": rpc error: code = NotFound desc = could not find container \"e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234\": container with ID starting with e2a30714eb5ce4e40dc121a4173536f3c641fd097e4f94698339a33938c01234 not found: ID does not exist"
Jul 08 18:54:54.224035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.224002    2558 scope.go:117] "RemoveContainer" containerID="200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a"
Jul 08 18:54:54.224203 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:54:54.224188    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a\": container with ID starting with 200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a not found: ID does not exist" containerID="200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a"
Jul 08 18:54:54.224261 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.224207    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a"} err="failed to get container status \"200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a\": rpc error: code = NotFound desc = could not find container \"200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a\": container with ID starting with 200f851f068a3cea961085fc74fc961728ced311e0ec5172c8ea08755fd1165a not found: ID does not exist"
Jul 08 18:54:54.230124 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.230104    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"]
Jul 08 18:54:54.234296 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.234275    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2046dd63-openshift-default-6b8d9bb94c-82l5w"]
Jul 08 18:54:54.247285 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.247267    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-data\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:54.247356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.247288    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3521721-4334-49ea-a200-82af15c1f3ab-istiod-ca-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:54.247356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.247301    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b67pj\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-kube-api-access-b67pj\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:54.247356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.247314    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3521721-4334-49ea-a200-82af15c1f3ab-istio-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:54.247356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.247326    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-istio-envoy\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:54.247356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.247336    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3521721-4334-49ea-a200-82af15c1f3ab-workload-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:54.247356 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:54.247349    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3521721-4334-49ea-a200-82af15c1f3ab-istio-podinfo\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:54:55.482498 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:55.482457    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" path="/var/lib/kubelet/pods/b3521721-4334-49ea-a200-82af15c1f3ab/volumes"
Jul 08 18:54:58.462785 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:58.462754    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:58.585417 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:58.585386    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:54:59.148662 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:54:59.148630    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:05.068335 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:05.068299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:05.174498 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:05.174459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:05.268593 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:05.268548    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:15.822429 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:15.822379    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:16.168443 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:16.168410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:27.881216 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:27.881177    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:37.150353 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:37.150313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:42.999399 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:42.999365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:43.658592 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.658561    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"]
Jul 08 18:55:43.658917 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.658903    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy"
Jul 08 18:55:43.658971 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.658920    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy"
Jul 08 18:55:43.658971 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.658936    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy"
Jul 08 18:55:43.658971 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.658942    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy"
Jul 08 18:55:43.658971 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.658952    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a18fb9-4a97-478f-a42b-aee3ac468775" containerName="maas-api"
Jul 08 18:55:43.658971 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.658957    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a18fb9-4a97-478f-a42b-aee3ac468775" containerName="maas-api"
Jul 08 18:55:43.659128 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.659014    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy"
Jul 08 18:55:43.659128 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.659024    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a18fb9-4a97-478f-a42b-aee3ac468775" containerName="maas-api"
Jul 08 18:55:43.661981 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.661964    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.664582 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.664560    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c2f39d-openshift-default-dockercfg-ncr4l\""
Jul 08 18:55:43.674095 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.674073    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"]
Jul 08 18:55:43.782654 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.782620    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-certs\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.782654 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.782666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-data\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.782894 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.782753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f742e2-e8c5-493d-8f51-116342da09fe-istio-podinfo\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.782894 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.782789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-istio-token\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.782894 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.782860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-credential-socket\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.782894 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.782891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-envoy\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.783054 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.782925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5sw8\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-kube-api-access-b5sw8\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.783054 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.782961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f742e2-e8c5-493d-8f51-116342da09fe-istiod-ca-cert\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.783054 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.783013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-socket\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883444 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-credential-socket\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883444 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-envoy\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883655 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883475    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5sw8\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-kube-api-access-b5sw8\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883655 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f742e2-e8c5-493d-8f51-116342da09fe-istiod-ca-cert\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883655 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-socket\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883655 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-certs\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883655 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-data\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883913 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f742e2-e8c5-493d-8f51-116342da09fe-istio-podinfo\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883913 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-istio-token\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.883913 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.883862    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-credential-socket\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.884067 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.884030    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-certs\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.884121 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.884054    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-socket\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.884223 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.884201    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-data\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.884307 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.884289    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f742e2-e8c5-493d-8f51-116342da09fe-istiod-ca-cert\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.885792 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.885771    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-envoy\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.886097 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.886081    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f742e2-e8c5-493d-8f51-116342da09fe-istio-podinfo\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.892114 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.892086    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-istio-token\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.892315 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.892271    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5sw8\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-kube-api-access-b5sw8\") pod \"e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") " pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:43.972188 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:43.972092    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:44.106272 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.106240    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"]
Jul 08 18:55:44.109276 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:55:44.109244    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f742e2_e8c5_493d_8f51_116342da09fe.slice/crio-514ca2313b11525a7dae925ecb00b482df535207145920d06b32b52bf70a2ece WatchSource:0}: Error finding container 514ca2313b11525a7dae925ecb00b482df535207145920d06b32b52bf70a2ece: Status 404 returned error can't find the container with id 514ca2313b11525a7dae925ecb00b482df535207145920d06b32b52bf70a2ece
Jul 08 18:55:44.111470 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.111441    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:55:44.111580 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.111519    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:55:44.111580 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.111566    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 08 18:55:44.425203 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.425171    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb" event={"ID":"38f742e2-e8c5-493d-8f51-116342da09fe","Type":"ContainerStarted","Data":"1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23"}
Jul 08 18:55:44.425375 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.425227    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb" event={"ID":"38f742e2-e8c5-493d-8f51-116342da09fe","Type":"ContainerStarted","Data":"514ca2313b11525a7dae925ecb00b482df535207145920d06b32b52bf70a2ece"}
Jul 08 18:55:44.447981 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.447912    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb" podStartSLOduration=1.447893136 podStartE2EDuration="1.447893136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:55:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:55:44.447326062 +0000 UTC m=+2383.482982707" watchObservedRunningTime="2026-07-08 18:55:44.447893136 +0000 UTC m=+2383.483549782"
Jul 08 18:55:44.551131 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.551094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:44.972218 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:44.972177    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:45.978723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:45.978680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:46.390264 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:46.390229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:46.435111 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:46.435079    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:46.436113 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:46.436093    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:55:46.469743 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:46.469708    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:55:50.931007 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:55:50.930975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:57:36.128142 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:57:36.128107    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:57:42.801211 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:57:42.801174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:57:42.858710 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:57:42.858650    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:57:46.032758 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:57:46.032725    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:58:12.293873 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:58:12.293839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:58:46.122491 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:58:46.122450    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:58:55.670544 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:58:55.670509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:58:56.161015 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:58:56.160979    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:59:02.127328 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:02.127291    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:59:02.228500 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:02.228467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:59:02.392720 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:02.392688    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"]
Jul 08 18:59:02.392929 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:02.392890    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb" podUID="38f742e2-e8c5-493d-8f51-116342da09fe" containerName="istio-proxy" containerID="cri-o://1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23" gracePeriod=30
Jul 08 18:59:02.413913 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:02.413882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:59:06.092135 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:06.092106    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:59:07.648998 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.648973    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:59:07.772255 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772136    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-credential-socket\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772255 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772211    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-socket\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772255 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772246    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-envoy\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772293    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5sw8\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-kube-api-access-b5sw8\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-certs\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772409    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-data\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772435    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-istio-token\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772460    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:59:07.772525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772485    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f742e2-e8c5-493d-8f51-116342da09fe-istio-podinfo\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772508    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f742e2-e8c5-493d-8f51-116342da09fe-istiod-ca-cert\") pod \"38f742e2-e8c5-493d-8f51-116342da09fe\" (UID: \"38f742e2-e8c5-493d-8f51-116342da09fe\") "
Jul 08 18:59:07.772882 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772530    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:59:07.772882 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772660    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:59:07.772882 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772676    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:59:07.772882 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772839    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-certs\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:07.772882 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772858    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-data\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:07.772882 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772873    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-credential-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:07.773128 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772888    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-workload-socket\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:07.773128 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.772922    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38f742e2-e8c5-493d-8f51-116342da09fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:59:07.774597 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.774576    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:59:07.774726 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.774706    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38f742e2-e8c5-493d-8f51-116342da09fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 18:59:07.774955 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.774937    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:59:07.775012 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.774988    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-kube-api-access-b5sw8" (OuterVolumeSpecName: "kube-api-access-b5sw8") pod "38f742e2-e8c5-493d-8f51-116342da09fe" (UID: "38f742e2-e8c5-493d-8f51-116342da09fe"). InnerVolumeSpecName "kube-api-access-b5sw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:59:07.873723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.873686    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-istio-token\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:07.873723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.873717    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38f742e2-e8c5-493d-8f51-116342da09fe-istio-podinfo\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:07.873723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.873726    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38f742e2-e8c5-493d-8f51-116342da09fe-istiod-ca-cert\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:07.873723 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.873736    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38f742e2-e8c5-493d-8f51-116342da09fe-istio-envoy\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:07.873993 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:07.873744    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5sw8\" (UniqueName: \"kubernetes.io/projected/38f742e2-e8c5-493d-8f51-116342da09fe-kube-api-access-b5sw8\") on node \"ip-10-0-138-160.ec2.internal\" DevicePath \"\""
Jul 08 18:59:08.301035 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.300992    2558 generic.go:356] "Generic (PLEG): container finished" podID="38f742e2-e8c5-493d-8f51-116342da09fe" containerID="1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23" exitCode=0
Jul 08 18:59:08.301254 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.301052    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"
Jul 08 18:59:08.301254 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.301079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb" event={"ID":"38f742e2-e8c5-493d-8f51-116342da09fe","Type":"ContainerDied","Data":"1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23"}
Jul 08 18:59:08.301254 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.301193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb" event={"ID":"38f742e2-e8c5-493d-8f51-116342da09fe","Type":"ContainerDied","Data":"514ca2313b11525a7dae925ecb00b482df535207145920d06b32b52bf70a2ece"}
Jul 08 18:59:08.301254 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.301223    2558 scope.go:117] "RemoveContainer" containerID="1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23"
Jul 08 18:59:08.310448 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.310430    2558 scope.go:117] "RemoveContainer" containerID="1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23"
Jul 08 18:59:08.310732 ip-10-0-138-160 kubenswrapper[2558]: E0708 18:59:08.310714    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23\": container with ID starting with 1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23 not found: ID does not exist" containerID="1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23"
Jul 08 18:59:08.310786 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.310741    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23"} err="failed to get container status \"1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23\": rpc error: code = NotFound desc = could not find container \"1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23\": container with ID starting with 1fc687939e9cf4882de5238f3e3b0ad4ed45ff6822b3b8abe0ddacff717d4f23 not found: ID does not exist"
Jul 08 18:59:08.323257 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.323229    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"]
Jul 08 18:59:08.328771 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.328746    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c2f39d-openshift-default-77666d75c9-sxbtb"]
Jul 08 18:59:08.663029 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.663004    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9cw5v_54775a2a-d9f0-44f9-9098-74ccdc97a86d/manager/0.log"
Jul 08 18:59:08.785431 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:08.785393    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sks74_09de7ba4-85b0-43d2-8387-2da9283f594d/manager/0.log"
Jul 08 18:59:09.038876 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:09.038802    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vlvbt_c4e57f68-24fc-4dfd-8bc5-f3bf76834da3/server/0.log"
Jul 08 18:59:09.161930 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:09.161886    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vzj22_652f953b-bfa2-4ab0-a0c6-3e503cdb36c6/manager/0.log"
Jul 08 18:59:09.277484 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:09.277457    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-6lvbf_ebd02d28-0b5d-4121-99a4-7650fc93bf04/copy-manifests/0.log"
Jul 08 18:59:09.290043 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:09.289950    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-6lvbf_ebd02d28-0b5d-4121-99a4-7650fc93bf04/manager/0.log"
Jul 08 18:59:09.481274 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:09.481243    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38f742e2-e8c5-493d-8f51-116342da09fe" path="/var/lib/kubelet/pods/38f742e2-e8c5-493d-8f51-116342da09fe/volumes"
Jul 08 18:59:11.057899 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:11.057854    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-b7hjf_ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7/manager/0.log"
Jul 08 18:59:12.174358 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:12.174333    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6p9rk_9a219446-a2ff-49dd-bd65-ea04ea6d4ab7/discovery/0.log"
Jul 08 18:59:12.286329 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:12.286304    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57657c797d-9ts86_2e177bdb-9738-4620-b8bb-5acbacaab9ec/kube-auth-proxy/0.log"
Jul 08 18:59:12.513861 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:12.513767    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9hwdn_cc044107-9fe4-47a2-9bf5-4411b79bb4db/istio-proxy/1.log"
Jul 08 18:59:13.216417 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:13.216393    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-7bb6g_41b98e65-fb12-46c8-85e7-cfc67b2afa35/main/0.log"
Jul 08 18:59:13.445293 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:13.445266    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-cnnrt_e79ac5d6-4781-43fb-825c-099930d8eb73/main/0.log"
Jul 08 18:59:13.561867 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:13.561786    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjxmcm_c62549fe-74ff-4d62-937e-a2cdd453326f/main/0.log"
Jul 08 18:59:17.954787 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:17.954752    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:59:18.046116 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:18.046083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log" limit=1024
Jul 08 18:59:20.633006 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:20.632978    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c2ct2_ac55bc61-004b-4008-91b5-011e34bb8b29/global-pull-secret-syncer/0.log"
Jul 08 18:59:20.727081 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:20.727056    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2qk6t_98bd3e18-c809-4fce-bdaf-217db4b24b83/konnectivity-agent/0.log"
Jul 08 18:59:20.870234 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:20.870203    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-160.ec2.internal_bbb64130c7b615dfb98b4e6af62c0947/haproxy/0.log"
Jul 08 18:59:26.418578 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:26.418508    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-b7hjf_ec6fbcf4-1b44-4b03-92c4-8d32c8ab5bc7/manager/0.log"
Jul 08 18:59:28.893811 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:28.893785    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tvnt5_b9cf4a80-b03d-49a4-9508-aa35eae9257e/node-exporter/0.log"
Jul 08 18:59:28.917935 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:28.917901    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tvnt5_b9cf4a80-b03d-49a4-9508-aa35eae9257e/kube-rbac-proxy/0.log"
Jul 08 18:59:28.937777 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:28.937756    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tvnt5_b9cf4a80-b03d-49a4-9508-aa35eae9257e/init-textfile/0.log"
Jul 08 18:59:30.625949 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.625917    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"]
Jul 08 18:59:30.626337 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.626267    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38f742e2-e8c5-493d-8f51-116342da09fe" containerName="istio-proxy"
Jul 08 18:59:30.626337 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.626279    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="38f742e2-e8c5-493d-8f51-116342da09fe" containerName="istio-proxy"
Jul 08 18:59:30.626337 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.626336    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="38f742e2-e8c5-493d-8f51-116342da09fe" containerName="istio-proxy"
Jul 08 18:59:30.626443 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.626345    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3521721-4334-49ea-a200-82af15c1f3ab" containerName="istio-proxy"
Jul 08 18:59:30.629644 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.629623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.632434 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.632410    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hq9s\"/\"openshift-service-ca.crt\""
Jul 08 18:59:30.632558 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.632477    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6hq9s\"/\"default-dockercfg-nlchm\""
Jul 08 18:59:30.633460 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.633445    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hq9s\"/\"kube-root-ca.crt\""
Jul 08 18:59:30.638604 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.638547    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"]
Jul 08 18:59:30.656348 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.656323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmzjz\" (UniqueName: \"kubernetes.io/projected/ab69165a-1873-4652-b437-7f072e2850f9-kube-api-access-bmzjz\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.656495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.656377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-sys\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.656495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.656432    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-podres\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.656495 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.656459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-lib-modules\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.656631 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.656512    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-proc\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.756853 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.756820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-proc\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.757030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.756873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmzjz\" (UniqueName: \"kubernetes.io/projected/ab69165a-1873-4652-b437-7f072e2850f9-kube-api-access-bmzjz\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.757030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.756898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-sys\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.757030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.756926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-podres\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.757030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.756945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-lib-modules\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.757030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.756959    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-proc\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.757030 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.757020    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-sys\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.757276 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.757069    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-lib-modules\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.757276 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.757077    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ab69165a-1873-4652-b437-7f072e2850f9-podres\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.765412 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.765389    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmzjz\" (UniqueName: \"kubernetes.io/projected/ab69165a-1873-4652-b437-7f072e2850f9-kube-api-access-bmzjz\") pod \"perf-node-gather-daemonset-qd2hz\" (UID: \"ab69165a-1873-4652-b437-7f072e2850f9\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:30.939996 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:30.939957    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:31.064845 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:31.064816    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"]
Jul 08 18:59:31.066776 ip-10-0-138-160 kubenswrapper[2558]: W0708 18:59:31.066740    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podab69165a_1873_4652_b437_7f072e2850f9.slice/crio-0c01235cff030d81873cdc3a39b19f9e414b4d5a8b712c779fd0aa9dc2c54b0e WatchSource:0}: Error finding container 0c01235cff030d81873cdc3a39b19f9e414b4d5a8b712c779fd0aa9dc2c54b0e: Status 404 returned error can't find the container with id 0c01235cff030d81873cdc3a39b19f9e414b4d5a8b712c779fd0aa9dc2c54b0e
Jul 08 18:59:31.406195 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:31.406165    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz" event={"ID":"ab69165a-1873-4652-b437-7f072e2850f9","Type":"ContainerStarted","Data":"c1c8b4a8781711abf86d628188405fa406407c8e5a2e533458cc4ff417219ad3"}
Jul 08 18:59:31.406366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:31.406218    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz" event={"ID":"ab69165a-1873-4652-b437-7f072e2850f9","Type":"ContainerStarted","Data":"0c01235cff030d81873cdc3a39b19f9e414b4d5a8b712c779fd0aa9dc2c54b0e"}
Jul 08 18:59:31.406431 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:31.406368    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:31.426131 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:31.426085    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz" podStartSLOduration=1.426072557 podStartE2EDuration="1.426072557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:31.424361612 +0000 UTC m=+2610.460018257" watchObservedRunningTime="2026-07-08 18:59:31.426072557 +0000 UTC m=+2610.461729201"
Jul 08 18:59:33.458600 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:33.458569    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvw86_b20261f6-ce00-4423-8a9a-eb2e0d60e8e7/dns/0.log"
Jul 08 18:59:33.480438 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:33.480413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvw86_b20261f6-ce00-4423-8a9a-eb2e0d60e8e7/kube-rbac-proxy/0.log"
Jul 08 18:59:33.648101 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:33.648068    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hp7x6_ad07d4bb-fdd7-4a94-8d8d-155416ad676c/dns-node-resolver/0.log"
Jul 08 18:59:34.196879 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:34.196848    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pg98t_5be65041-d2a5-4190-ac42-afc16106a8b4/node-ca/0.log"
Jul 08 18:59:35.253989 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:35.253943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6p9rk_9a219446-a2ff-49dd-bd65-ea04ea6d4ab7/discovery/0.log"
Jul 08 18:59:35.305979 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:35.305956    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57657c797d-9ts86_2e177bdb-9738-4620-b8bb-5acbacaab9ec/kube-auth-proxy/0.log"
Jul 08 18:59:35.366477 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:35.366449    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9hwdn_cc044107-9fe4-47a2-9bf5-4411b79bb4db/istio-proxy/0.log"
Jul 08 18:59:35.394499 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:35.394477    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9hwdn_cc044107-9fe4-47a2-9bf5-4411b79bb4db/istio-proxy/1.log"
Jul 08 18:59:36.215908 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:36.215877    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v59xd_b90ffd34-ed4c-4158-8256-b2d2c107666e/serve-healthcheck-canary/0.log"
Jul 08 18:59:36.687750 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:36.687720    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57nhm_279f241d-d4c7-476a-a59b-e1b62ffc3b98/kube-rbac-proxy/0.log"
Jul 08 18:59:36.707634 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:36.707607    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57nhm_279f241d-d4c7-476a-a59b-e1b62ffc3b98/exporter/0.log"
Jul 08 18:59:36.730234 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:36.730210    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57nhm_279f241d-d4c7-476a-a59b-e1b62ffc3b98/extractor/0.log"
Jul 08 18:59:37.421366 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:37.421341    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-qd2hz"
Jul 08 18:59:38.995140 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:38.995108    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9cw5v_54775a2a-d9f0-44f9-9098-74ccdc97a86d/manager/0.log"
Jul 08 18:59:39.079489 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:39.079460    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sks74_09de7ba4-85b0-43d2-8387-2da9283f594d/manager/0.log"
Jul 08 18:59:39.184525 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:39.184501    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vlvbt_c4e57f68-24fc-4dfd-8bc5-f3bf76834da3/server/0.log"
Jul 08 18:59:39.242735 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:39.242705    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vzj22_652f953b-bfa2-4ab0-a0c6-3e503cdb36c6/manager/0.log"
Jul 08 18:59:39.304325 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:39.304253    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-6lvbf_ebd02d28-0b5d-4121-99a4-7650fc93bf04/manager/0.log"
Jul 08 18:59:39.321412 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:39.321386    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-6lvbf_ebd02d28-0b5d-4121-99a4-7650fc93bf04/copy-manifests/0.log"
Jul 08 18:59:40.892336 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:40.892305    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vm85t_791655eb-c42a-4a26-b152-329a66adca58/openshift-lws-operator/0.log"
Jul 08 18:59:41.205887 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:41.205855    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6p9rk_9a219446-a2ff-49dd-bd65-ea04ea6d4ab7/discovery/0.log"
Jul 08 18:59:41.217448 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:41.217419    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57657c797d-9ts86_2e177bdb-9738-4620-b8bb-5acbacaab9ec/kube-auth-proxy/0.log"
Jul 08 18:59:41.250460 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:41.250435    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9hwdn_cc044107-9fe4-47a2-9bf5-4411b79bb4db/istio-proxy/0.log"
Jul 08 18:59:41.276524 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:41.276503    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9hwdn_cc044107-9fe4-47a2-9bf5-4411b79bb4db/istio-proxy/1.log"
Jul 08 18:59:42.646897 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:42.646868    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6p9rk_9a219446-a2ff-49dd-bd65-ea04ea6d4ab7/discovery/0.log"
Jul 08 18:59:42.658129 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:42.658100    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57657c797d-9ts86_2e177bdb-9738-4620-b8bb-5acbacaab9ec/kube-auth-proxy/0.log"
Jul 08 18:59:42.693089 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:42.693062    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9hwdn_cc044107-9fe4-47a2-9bf5-4411b79bb4db/istio-proxy/0.log"
Jul 08 18:59:42.719716 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:42.719692    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9hwdn_cc044107-9fe4-47a2-9bf5-4411b79bb4db/istio-proxy/1.log"
Jul 08 18:59:47.732371 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:47.732345    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ss2jv_65ad62ef-ab57-4306-8850-3a6030c73c66/kube-multus-additional-cni-plugins/0.log"
Jul 08 18:59:47.757674 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:47.757642    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ss2jv_65ad62ef-ab57-4306-8850-3a6030c73c66/egress-router-binary-copy/0.log"
Jul 08 18:59:47.777084 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:47.777055    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ss2jv_65ad62ef-ab57-4306-8850-3a6030c73c66/cni-plugins/0.log"
Jul 08 18:59:47.798794 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:47.798760    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ss2jv_65ad62ef-ab57-4306-8850-3a6030c73c66/bond-cni-plugin/0.log"
Jul 08 18:59:47.818766 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:47.818720    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ss2jv_65ad62ef-ab57-4306-8850-3a6030c73c66/routeoverride-cni/0.log"
Jul 08 18:59:47.838668 ip-10-0-138-160 kubenswrapper[2558]: I0708 18:59:47.838641    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ss2jv_65ad62ef-ab57-4306-8850-3a6030c73c66/whereabouts-cni-bincopy/0.log"